For some reason idleness is also hard to bear for a lot of people. I find it hard to not work for a longer period of time than a week or two - unless there is some substitute activity for it like travel.
They say "doing nothing is the most tiring of all activities"