I followed also about 800 people in the first month. Then I realized that I really don't like the content all of them created thus I started cleaning the list. It happens nowadays also that I follow someone and then after a few weeks to realize that I don't like his/her posts anymore and unfollow so I don't see that as a problem. A real problem would be to keep your feed cluttered with tens of posts from people you no longer read and interact with.