I wonder if it would be useful for you to try and be up and working on your self improvement things while the family is asleep.

Maybe try getting to sleep earlier so that you can be up and exercising before the family wakes up.

That might help you start achieving at least 2 of your goals (fitness and sleep) without any impact on family time.