The main issue is that gravity does not fit well with the quantum world. Therefore, at the level of elementary particles, it is tricky to include gravity. This is a whole field of research on its own, and a lot of progress has been made over the last decades. However, the problem is not solved yet (will it ever be?).