So how does gravity work if it's not pulling everything evenly to one central point? In the world you describe we would face some fundamental problems with relativistic physics which we know are correct through repeated experimental evidence.