Your steem power (SP) does not diminish but the USD value has been.
Also your voting power goes down 2% each vote you make and takes 24 hours, to recover 20%

Hope this helps.