You can safely remove the bot, it doesn't affect your existing Bytes, you can remove the bot even when the transaction is confirmed. Some bots that you have smart-contracts with, you can't remove yet (maybe in future).

I don't remove my bots because existing bots can also notify me when something changes (not many bots do that) or when you get reward for referral (you don't need to have bot installed to get referrals).

What I strongly suggest to do is Full backup because anything can happen and it would be bad if you loose your wallet for some reason and doesn't have backup.