The small town of Wallerstein, with just over 3,000 inhabitants, was founded at the same time as the construction of the old castle (Altes Schloss), at the beginning of the 13th century.

It was destroyed, along with the castle, during the Thirty Years' War, and rebuilt again around the new castle.