One problem I see with that would be that it would also exclude those votes from users who send other people upvotes through bots in the hope of them getting a little bit bigger return. On the other hand it doesn't look like anybody really uses bots in that way anymore, so it might be neglectable...