Ab Initio Components and Parameters

ISN (Internal Sequence Number) values are unique within each individual file but not across the entire database. Each file maintains its own ISN sequence independently.

In Ab Initio, ASCII files, comma-separated values (CSV), and Excel spreadsheets are all commonly used flat file formats for data input and output. The component supports multiple delimited and fixed-width file formats.

Ab Initio uses .DML (Data Manipulation Language) files to store record format definitions and metadata externally to the graph. This allows reuse of metadata definitions across multiple graphs and components.

The Dedup Sort component uses the ramp parameter to specify the acceptable rate of rejected records during processing. It defines the threshold for how many reject events can occur relative to the total number of records processed.

In Dedup Sort, the keep parameter specifies which duplicate records to retain (first, last, or based on a key). Since deduplication fundamentally requires deciding which records to preserve, this parameter is mandatory for the component to function correctly.

The Ab Initio Join component has a maximum capacity of 20 input ports, allowing it to combine data from up to 20 different flows simultaneously. This is a hard architectural limit of the component.

The record-required parameter is specific to Explicit join type in Ab Initio. It specifies how many input flows must contribute a record for output to be generated. This parameter doesn't apply to Implicit joins where the join conditions define the relationship.

The Join component's max-memory parameter defaults to 8388608 bytes (8 MB), which controls the amount of memory available for the join operation. This is the standard default value when not explicitly configured.

When input_select returns NULL in a Normalize component, three actions occur: the record goes to the reject port, an error message is written to the error port, and if these ports aren't connected, the record is silently discarded. This is the standard error handling behavior.