Buddhist caves of Uparkot, Gujarat have been constructed in order to be utilized as residences for the monks and have been carved out of stone. These quarters of monks are over 2000 years of age. It is believed that the most ancient of these Buddhist caves belong to the period around 3rd to the 4th century A.D. and are the simplest of all the caves, located on the border of the Sudarshan Lake (which is no longer existent) and the northern portion of the region of Uparkot. The interior chambers of the Buddhist Caves are subdivided into east-west crest.

The significant parts of these quarters comprise the `L` shaped wing utilized by the monks, as well as the rectangular shaped western wing. The `L` shaped wings serve as important monsoon shelter for the monks. Such caves are known to be the oldest monastic settlements in this region and have been created from rocks during the regime of king Ashoka. However, they were soon isolated since certain cracks formed in the rocks permitted water seepage into the chambers of the monks, thus making them unsuitable for daily utility. Certain historical accounts assert that after abandoning these caves, they shifted to Maharashtra. Quarrying activities had demolished the Khapara Kodia.

The caves of Baba Pyara are present near Khapara Kodia, across the region of Uparkot and are quite close to Modhimath. Some other caves possess a `Chaitya` hall and a spacious court, particularly the south group caves. In the northern group, four Buddhist caves exist. The door jambs and the pillars of these caves are inspired by the artistic traditions and cultures of Satavahanas, and are known to belong to 1st as well as the 2nd century AD. The caves comprise 13 rooms, present in three different stories and are decorated with beautiful carvings depicting Buddhist symbolism. The stories are about 150 feet in height and are in a much better condition as compared to the Khapara Kodia caves. The last of these caves, which are about 1900 years old, are situated near the Adi-Kadi Vav.