The double pipe symbol '||' in REXX is the concatenation operator used to join two literals or strings together without any spaces. For example, 'Hello' || 'World' produces 'HelloWorld'. This is different from the abuttal operator (just placing strings next to each other with a space in between). The || operator is specifically for concatenation of literals and expressions.