Your grandfather is a wise man. Or reasonable at the very least. A lot of people seem to actively look for something to hate, and it seems to most logical to say "Nazis are bad, and nazis were german, so germans are bad!" It's the kind of shallow thinking that runs deep in humanity.