COBOL programs must follow a strict hierarchical order: Identification Division (program identification), Environment Division (environment configuration), Data Division (data definitions), and Procedure Division (executable logic). This order is mandatory and cannot be rearranged arbitrarily.