Description
This step provides the ability to read data from a delimited file.
Options
The table below describes the options available for the CSV Input step:
Option |
Description |
---|---|
Step name |
Name of the step.
|
Filename |
Specify the name of the CSV file to read from. |
Delimiter |
Specify the file delimiter character used in the target file. |
Enclosure |
Specify the enclosure character used in the target file. |
NIO buffer size |
This is the size of the read buffer. It represents the amount of bytes that is read in one time from disk. |
Lazy conversion |
The lazy conversion algorithm will try to avoid unnecessary data type conversions and can result in a significant performance improvements if this is possible. The typical example that comes to mind is reading from a text file and writing back to a text file. |
Header row present? |
Enable this option if the target file contains a header row containing column names. |
Add filename to result |
Adds the CSV filename(s) read to the result of this transformation. A unique list is being kept in memory that can be used in the next job entry in a job, for example in another transformation. |
The row number field name (optional) |
The name of the Integer field that will contain the row number in the output of this step. |
Running in parallel? |
Check this box if you will have multiple instances of this step running (step copies) and if you want each instance to read a separate part of the CSV file(s).
|
File Encoding |
Specify the encoding of the file being read. |
Fields Table |
This table contains an ordered list of fields to be read from the target file. |
Preview button |
Click to preview the data coming from the target file. |
Get Fields button |
Click to return a list of fields from the target file based on the current settings (i.e. Delimiter, Enclosure, etc.). All fields identified will be added to the Fields Table. |