if you're getting harassed by downvoters, set your rewards to "declined" so they don't hurt your rep (but you still get rep from upvotes!!)

You've got a pretty decent rep (79!!). Downvoters with lower rep than you won't bring your rep down.

Also, even if you decline rewards (on your own posts and comments), you still get rewards for your curation upvotes!