The Archaeological Survey of India has found ancient caves and temples, remains of Buddhist structures and mural inscriptions bearing names of cities like Mathura and Kaushambi in old scripts during its recent exploration at Bandhavgarh in Madhya Pradesh, officials said on Wednesday.