I felt exactly the same! I was hesitant to visit this famous place for fear of the over-crowdedness. And when I hiked there, I was stunned by the harmony between the ruins and the natural setting, and I was lucky to have experienced the sun, the rain and the fairyland shrouded by mist later on. I stayed there a whole day and was reluctant to leave. Totally different experience than I imagined! =)