The Tapkeshwar Temple is alleged to be 6,000 years old. It has a natural Shivalinga in the cave.

It is also believed that this was used as a residence by Dronacharya, the teacher of the Pandavas and Kauravas in the Hindu scripture Mahabharata; the cave is called Drona Cave after him. Dronacharya's wife Kalyani was unable to breastfeed their newborn son Ashwatthama. As Dronacharya was unable to afford a cow or cow's milk, Ashwatthama prayed to Shiva, who then fed him milk dripping from the Shivalinga in the cave.