I have never thought about 'forgetting' this way.
Often we say: I forgive, but I never forget!
And I agree that that's actually NOT the right way to handle things.
If you only forgive but don't forget, you definitely still hold a grudge against that person. And how are you supposed to move on then ?!