Using Old Phone As Hardware Wallet

Would It be possible to use an old smartphone as a hardware wallet by simply disconnecting it from the net and removing the sim card ?

I'm thinking if I completely wipe my old phone and never download any new apps or visit a web page ..should be a pretty safe device ?

So if you want to check your balance or send coins just power up the phone and then switch of the device when you're done .