I often get criticized for this. But especially with Bitcoin I would rather use Coinbase as a wallet and use the 2FA before using any hot wallets. Exodus and Jaxx have nice user interfaces but are way to insecure for my liking. I agree with your first statement, take the plunge and get a Ledger or Tezor.