The remains of Stefan Lazarevic Castle are still preserved in the northwestern part of the Upper Town. The citadel or inner town was firstly designed as a Byzantium fortress in the twelfth century. It was rebuilt during the rule of despot Stefan Lazarevic during the period between 1404 and 1427. Archaeological researches, which were carried out systematically until 1480, led to the discovery of ramparts with towers, cobblestone access road from the northeastern side of the castle, with rounded pillars which once supported the drawbridge.

Archaeologists also found the remains of armaments, stone cannon balls, pottery and coin remnants, and other items from despot’s time and subsequent epochs. The castle of despot Stefan Lazarevic was completely destroyed during Austrian-Turkish fights at the end of the seventeenth century.