Cats are incredibly fussy about people they like. And if a cat does not like its owner, he will leave it and look for another. They do it constantly. They leave and live with someone different. Seeing me with my cat made me more pleasing to his eyes.
