You can keep your units safe by moving them to one of your other bases while the first one is under attack, but yes, you would need to be online for that ;)