That's the price of being foreigner. In every country there are some locals that always feel like the foreigners are "trying to take their place", but after a while they'll get used to you and you'll be part of the community.