It is unnecessary. Limes don't really benefit greatly from refrigeration. Maybe I was too harsh in my word choice, so I edited in a tip about them.

If you think they are getting near to being bad, you can store them in the fridge then. It will give you extra time to use them up. But while they are fine, just leave them out.