Missing blocks by itself isn’t an indication that someone shouldn’t be a witness. It depends on the reason. If a witness is missing blocks because they don’t have proper infrastructure or failover processes in place, that is bad - but that is not the only reason blocks are missed. Most of the time there is a good reason for it, and not something to get unvoted for.