I recently did the same even though I left some people who were not active in the past 2-3 months, hoping they will come back.

I recommend you using steem agency by @SirCork where you can see the list of dead followers and following the dead so you don't have to go through it name by name. :)