With kids, it depends on the day.
The baroque library hall and the climb up the Astronomical Tower for a 360° Old Town view are a quieter, more curated experience than the castle crowds. The honest catch: it's guided-tour-only on fixed slots, the tour is fairly brisk and you can't linger or photograph freely in the hall. Book ahead in season or you'll be turned away.