It's generally held that a downvote is best used as as flagging feature for offensive comments, spam, and wildly inaccurate information. Of course, one can pick their own reasons for flagging, but without any explanation from him I'm free to speculate why he's doing it, particularly based on his past behaviour.