normally you should lose 2% votingpower when you upvote on 100% and you gain 20% every day. you shouldnt lose power just not upvoting. You can check if you upvoted someone on steemd.com/@immortal1663 there you have a history ;)