Without some adjustments to the vote, the vote buyer is going to lose out the most?

With 50/50 split yes, the voting services will have to give higher upvotes because only 50% returns to vote buyers

This means less upvotes from bid bots but with 50% it will also give more curation rewards - so it should balance itself. But really no one knows what's gonna happen :)