Off-line is for security against key compromise against internet or on computer vectors. As for public transactions and how they remain private, this is done by not reusing addresses, which was implemented by BIP-0032 as Hierarchical Deterministic wallets which every modern crypto wallet that uses bitcoin-based cryptocurrencies should automatically default to.