A majority of the let's say 100.000 users will rather agree on who the spammers are. Not all those users will have different spammers on their blacklists.
They might agree roughly on the number of real spammers, and that's what the blockchain has to handle.
In the end it is quite a democratic process.