Good on you to decide to leave. Some people are just not worth the effort of blending in. I know that sounds like denial. But that is true in some cases, sometimes it is worth the effort. You did great by realizing soon enough that this particular scenario will not work out.