Yeah I totally agree! It has to be muscle memory! I am a former police officer and I have drawn on many people. I have seen rookie officers panic and not even find the gun when their hand goes down. PRACTICE!

Don't just practice at the range when you are all comfortable, look for courses that challenge you.