'Back out of' is a phrasal verb meaning to withdraw from an agreement or commitment, especially at the last minute. The sentence means it's too late to withdraw from the holiday plans now. 'Back up' means to support, 'back down' means to yield in a confrontation.