Dr. Kalam left Rameshwaram to pursue higher education at the district headquarters in Ramanathapuram, as his father encouraged him to seek better opportunities. While he faced social challenges, his primary motivation for leaving was academic advancement.