I have considered ideas about using approval voting weight (like witnesses) to pick people who have the "power to flag". It gets very tricky to scale and to hold people accountable, especially with incumbents.

Another method that has been adopted is random "meta moderation" similar to how slashdot.org does it.