I just think someone with a decent IQ stands a better chance of avoiding being swallowed by the masses.

I agree, but they also have a better chance of subverting an otherwise fair system.