Correct - the problem here is that we need to be careful that the mining fee doesn't skyrocket, making the currency less enticing to use on a day-to-day basis. Nobody wants to pay $1 in transaction fees every time they buy a coffee. Some of the work on payment channels (see Lightning network) address this but are in the early stages and the technology has not yet been proven in the real world.