I can come and downvote you soon. :P

Yeah, it is more annoying, but like I said to @celestal a moment ago, I think he is using Partiko so the UI separates the Up/Downs and doesn't care much about weighting. It means that visually, a nothing downvote looks the same as a massive upvote.