I never had a fear of flying, but I also find it to be very peaceful - especially with noise cancelling headphones. And also as long as the flight is less than 4 hours, after the 4 hour mark I feel that I have a need to get up and move around, even if it's just to make another connecting flight.
Yes, the long ones CAN be a bit much, and the short ones are also not quite long enough to find your peace.