I don't consider it rude, as I don't consider conversation a "right". Sure I can comment freely, but I don't know the receiver's situation, so I don't expect a genuine reply, or even a reply at all.

I however try to reply to all of the comments I get. I love community interaction, and if you read my introduction post, one of my main goals is to consistently upvote comments on my posts to foster conversation.