The value of low SP account votes will certainly suffer a bit. If this makes it harder to grow may be a different aspect, though. The gain for higher SP accounts shown here is marginal and assumes that the voting behavior remains the same as now. As you say: time will tell :)