The Agra Fort was built by Emperor Akbar between 1565-1573, though it was originally a brick fort held by the Sikarwar Rajputs known as Badalgarh. Akbar rebuilt it using red sandstone, making it the main residence of the Mughal emperors until Shahjahan shifted the capital to Delhi. Babur founded the Mughal empire but didn't build this fort.