I think a more granular rating system than up or flag would be helpful, combined with some kind of diminishing returns on up voting the same users within X period of time would be helpful for helping to create some better content and distribute rewards more evenly.