Yes. Because both flagging and down-voting signifies that one has done something wrong.

And if such is not the case then all the pro-down-vote arguments revolving around being over-rewarded ring worse than hollow.