Anchor Your Actions to What Actually Matters