Multiple choice technology

Which stage can remove duplicates

  1. Sort stage

  2. Transformer stage

  3. Remove duplicate stage

  4. None of the above

Reveal answer Fill a bubble to check yourself
C Correct answer
Explanation

The Remove Duplicates stage is specifically designed to eliminate duplicate records from the data stream based on specified key columns. While Sort stages can group duplicates, and Transformers can filter them, the Remove Duplicates stage provides a dedicated, optimized operation for this specific task.