The Arulmigu Manakula Vinayagar Temple in Pondicherry is one such landmark that predates the French acquisition and remains standing even after the city was annexed by India. The temple, known as Sri Manakula Vinayagar, is dedicated to Lord Ganesha and even has a pet elephant that blesses visitors.
History:
The Arulmigu Manakula Vinayagar Temple, which dates back at least 500 years, has two interesting stories associated with it.
It is reported that in 1688, during French rule, the French built a fort exactly next to the temple. To make an impression on their fort, they considered relocating the Vinayagar Temple and began hurling the Ganesha idol into the sea. But, to their surprise, the idol would emerge on its own every time. When the French saw this, they gave up and became devoted followers of the Lord.
Another ancient legend surrounding this temple claims that about 300 years ago, a saint with gleaming eyes and a broad forehead gained samadhi at this celestial spot through his emancipation. Since then, it has been regarded as a fortunate location for newborn newborns. 
The temple is thought to have been built five centuries ago and contains beautifully painted friezes depicting stories from the Vedas and Upanishads. The temple’s exterior is adorned with intricately crafted stucco figurines, an iconic feature of traditional Dravidian architecture.