I know how I'm supposed to change the password, via the "edit" symbol in the above picture. The problem is that those symbols are not shown to me in the permissions page. I can't recall if I originally registered to Steemit via my Facebook account (it is possible), so that might have something to do with it, not sure.
The image is from pfunk's post, credit goes to him:
https://steemit.com/steemit-guides/@pfunk/your-steem-account-is-worth-money-how-to-secure-it-with-a-new-owner-key-to-keep-it-yours-forever