By any chance, you mean "Neuschwanstein"? I have been there recently! There are actually two castles, "Hohenschwangau" and "Neuschwanstein" close to each other. Both are fascinating! Brace yourself for high fees and a ton of tourists though, I think this is one of the most popular places in beautiful Bavaria!
RE: Traveling with family. The Würzburg residence