Indeed,
When I was there my colleague (female) did not want to stay downtown because of the loads of refugees - I'm glad that someone helps the refugees, but Greece is bearing a lot of the pressure by themselves.
Personally I prefer to stay outdoors - a person that likes museums will really love Athens I'd guess.