Do you remember the name of the castle? Edinburgh has been one of those places I always wanted to see, it would be fun to organize a roadtrip to that castle when visiting there (I think that my list of must see places just gets longer and longer). But can definitely recommend visiting Potter studio!
RE: Travelling with my wife: The Harry Potter studio