Page Comparison

Step name

Name of the step.

Note: This name has to be unique in a single transformation.

Filename
  or
The filename field (data from previous steps)

Specify the name of the CSV file to read from.
  or
Select the fieldname that will contain the filename(s) to read from.
If this step receives data from a previous step, this option is enabled as well as the option to include the filename in the output.

Delimiter

Specify the file delimiter character used in the target file.

Enclosure

Specify the enclosure character used in the target file.

NIO buffer size

This is the size of the read buffer.  It represents the amount of bytes that is read in one time from disk.

Lazy conversion

Lazy The lazy conversion algorithm will try to avoid unnecessary data type conversions and can result in a significant performance improvements . Check to enableif this is possible.  The typical example that comes to mind is reading from a text file and writing back to a text file.

Header row present?

Enable this option if the target file contains a header row containing column names.

Add filename to result

Adds the CSV filename(s) read to the result of this transformation.  A unique list is being kept in memory that can be used in the next job entry in a job, for example in another transformation.

The row number field name (optional)

The name of the Integer field that will contain the row number in the output of this step.

Running in parallel?

Check this box if you will have multiple instances of this step running (step copies) and if you want each instance to read a separate part of the CSV file.

WARNING: For technical reasons, parallel reading of CSV files is only supported on files that don't have fields with line breaks or carriage returns in them.

File Encoding

Specify the encoding of the file being read.

Fields Table

This table contains an ordered list of fields to be read from the target file.

Preview button

Click to preview the data coming from the target file.

Get Fields button

Click to return a list of fields from the target file based on the current settings (i.e. Delimiter, Enclosure, etc.). All fields identified will be added to the Fields Table.