Some other thoughts I've had are that downvotes should cost the voter proportionally the same amount, or numerically the same amount. I don't think either will happen, but changes like this would still enable stopping spam and plagiarism, while making downvoting just for personal reasons less palatable for those doing it.

I reckon downvotes just aren't necessary except for spam and the like, and those can be handled by groups of spamcops.