The accumulator is a register in the Arithmetic Logic Unit (ALU) where intermediate arithmetic and logic results are stored. The ALU performs mathematical and logical operations, and the accumulator is central to this process. Input, output, and control units are separate components of the computer architecture.