The vertical stabilizer (the tail fin) provides directional stability and control. Without it, an aircraft would indeed be prone to spinning and loss of control, especially in crosswinds or during turns. It's a critical component for flight stability.