Few temples in India are more picturesquely located than that of Goddess Bhagavathi in Kanyakumari. It stands where three oceans meet: the Indian Ocean, the Bay of Bengal and the Arabian Sea. Sunrise and sunset can be seen from the same place. On full moon days, sunsets and moon rises can be seen at the same time.

There has been a temple of the Goddess at this place for over two thousand years. According to the temple's purana, a powerful demon, Banasura, was harassing the Devas. They sought Lord Siva's help. He invoked sakti & created Bhagavathi. The demon, hearing of Her beauty, coveted Her, though he knew it was ordained that a virgin would kill him. He threatened her and a battle developed and ultimately the demon was killed. The incident is depicted during the Navarathri festival at the temple.

About 183m from the coast there is a rocky island. According to tradition, the temple stood there originally. When the sea encroached, the rock became an islet, and the temple had to be removed to its present site. The rock contains the mark of a human foot. This is revered as a symbol of the "Sripadam" . It is on this rock that the Vivekananda memorial has been built.