MySQL Bulk Loader
Description
The MySQL Bulk Loader streams data from inside Kettle to a named pipe using "LOAD DATA INFILE 'FIFO File' INTO TABLE ...." into the database.
Further information about the used command can be found in the MySQL reference: LOAD DATA INFILE syntax
Note: This step actually does not work within a Windows system due to the use of mkfifo for named pipes. If you like, check out to use the GNU Core Utilities for Windows (but this is not officially supported).
Options
Option |
Description |
---|---|
Step name |
Name of the step. |
Connection |
Name of the database connection on which the target table resides. |
Target schema |
The name of the Schema for the table to write data to. This is important for data sources that allow for table names with dots '.' in it. |
Target table |
Name of the target table. |
Fifo file |
This is the fifo file used as a named pipe. When it does not exist it will be created with the command mkfifo and chmod 666 (this is the reason why it is not working in Windows). |
Delimiter |
Delimiter for the fields. (If not given, the tabulator is default.) |
Enclosure |
The enclosure used for strings. |
Escape character |
If the enclosure is in the field, it is escaped by the escape character. |
Character set |
The used character set (optional). |
Bulk size (rows) |
To split the data loads in chunks of data after which the data load will be restarted. |
Use replace clause? |
If checked, "REPLACE" is added to the command. If you specify, input rows replace existing rows. In other words, rows that have the same value for a primary key or unique index as an existing row. More details can be found in the MySQL reference. |
Use ignore clause? |
If checked, "IGNORE" is added to the command. If you specify, input rows that duplicate an existing row on a unique key value are skipped. More details can be found in the MySQL reference. |
Fields to load
With the "Get fields" button you can load the fields from the stream. With the "Edit mapping" button you can edit the mapping from the stream to the table fields when the table already exists.
Option |
Description |
---|---|
Table field |
Name of the field in the table. |
Stream field |
Name of the field in the stream. |
Field format OK? |
You can decide if the format should be kept (Don't change formatting) or changed:
|
Metadata Injection Support (7.x and later)
All fields of this step support metadata injection. You can use this step with ETL Metadata Injection to pass metadata to your transformation at runtime.