I know that feeling. We have spoken lately a lot about age and this is a side effect of it.
We had a sleep monitor app on our iphone connected to the watch and each morning I did check how my sleep was. And regardless what I did to improve it, it more or less stayed the same. So, some things are just like they are.
Lots of things which do have a impact on sleep, like alcohol consumption, caffeine, to much bright light and so on.
Also I used to be able to sleep out when I had the chance, but those times are also gone :(. Hate when I wake up at 8 on a Saturday in which I could sleep until 9 or 9.30. I just can't anymore.