I personally don't worry too much about it; if someone doesn't like my content I don't want to clutter up their feed. It happens to me a lot because I record and post music videos and some viewers/listeners are really into one particular style of music, and unsub or unfollow if my next post isn't jazz, rockabilly, or whatever style my previous post was. I don't think it's personal toward me, but personal to them. Greetings!