The first buildings at this site were erected in the year 1385 and were financed by the township of Munich as a sanction for a failed uprising against Stephen III (1375-1413) and his younger brothers. The Silver Tower (Silberturm), as the strongest bastion, was significantly situated next to the inner walls protecting the castle against the city. This sturdy new castle (Neuveste - new fortress), surrounded by wide moats at what used to be the very north eastern corner of the new double ring of walls, replaced the difficult to defend Old Court in the middle of the town as residence of the Wittelsbach rulers. The Dukes of the often divided country felt the urge to keep some distance from the frequently rebellious city dwellers at the one hand and for some defence against their warlike relatives at the other. As a result, they sought to build themselves a shelter impregnable and easy to leave (directly towards the glacis, without having to enter city lanes) at the same time.
The gothic foundation walls and the basement vaults of the old castle are the oldest surviving parts of the palace. The Residenz's development over the centuries didn't only take place out of its main centre, the Neuveste, but in addition grew out of several single parts and extensions, the first of which used to be the Antiquarium. Finally, after more than four centuries of development, the giant palace had practically replaced a whole former city quarter with barracks, a monastery, houses and gardens. It assembles the styles of the late Renaissance, as well as of Baroque, Rococo and Neo-Classicism.