Asch Castle was a small residence just outside the town wall rebuilt in 1541. On the 18th century engraving by Michael Wening the castle is surrounded by a moat. This was filled with the rubble of the town fire of 1865. The coat of arms is a tree, possibly an ash, which gave name to the Asch family.
In the present state of the building the Renaissance gables have been replaced by a hipped roof. The walls have painted decorations. Along the house runs the lively Bahnhofstraße.
Asch Caste is at the edge of Asch meadows (Aschwiesen), a wide stretch of grass below the old town and Westerberg hill. In summer sometimes horse races take place on the grounds.