These are twin hills which have rock-cut caves. Caves were built with artistic carvings around the 2nd century BCE. Travelers can find a temple at the top of Khandagiri hills. Temple has the statue of Risabhdev.
Udayagiri and Khandagiri Caves are partly natural and partly artificial caves of archaeological, historical and religious importance near the city of Bhubaneswar in Odisha, India. The caves are situated on two adjacent hills, Udayagiri and Khandagiri, mentioned as Kumari Parvat in the Hathigumpha inscription. They have a number of finely and ornately carved caves. It is believed that most of these caves were carved out as residential blocks for Jain monks during the reign of King Kharavela. Udayagiri means "Sunrise Hill" and has 18 caves while Khandagiri has 15 caves.
The caves of Udayagiri and Khandagiri, called lena or le?a in the inscriptions, were dug out mostly during the reign of Kharavela for the abode of Jaina ascetics. The most important of this group is Ranigumpha in Udayagiri which is a double storeyed monastery.
The famous caves In Udayagiri, Hathigumpha (cave 14) and Ganeshagumpha (cave 10) are especially well known due to art treasures of their sculptures and reliefs as well as due to their historical importance. Rani ka Naur (Queen's Palace cave, cave 1) is also an extensively carved cave and elaborately embellished with sculptural friezes. Khandagiri offers a fine view back over Bhubaneswar from its summit. The Ananta cave (cave 3) depicts carved figures of women, elephants, athletes, and geese carrying flowers.