The suburbs of the city surround the peak and Signal Hill on almost all sides, but strict management by city authorities has kept development of housing off the higher ground. The area is significant to the Cape Malay community, who historically lived in the Bo-Kaap quarter close to Lion's Head.
There are a number of historic graves and shrines (kramats) of Malay leaders on the lower slopes and on Signal Hill.