speaking about PoW, actually a lot of mining pools can provide 51% attack, so its hard to talk about safety, trust and decentralization in the moment, when our assets are in the hands of certain amount of online gurus.
speaking about PoS, as you said we easily find few accounts with an absurdly large balance, centralizing huge part of coins and power