Don't worry, all accounts the scammer has will be connected to him if he keeps downvoting your posts, and more people will know about his accounts. So in the long run he will lose more and not affect your own rating cause weak reputation accounts can't affect positive ones.