I have these same issues on Instagram, I understand the reason of following less people in regards to the algorithm trying to sort out who's important and who's not. But honestly I like to follow like minded people and I always think it's a little unfair that if you want to grow you sometimes have to unfollow.