So far the norm has been for downvoting to not signify mere disagreement but some sort of disapproval of the nature of the post itself (wrong category, spam, untagged NSFW, etc.). However, if we ever get to the point where usage explodes rapidly the new influx of users may not observe that convention and the norm would then change.