SAP HANA Bulk Loader

Step Name

Enter the name of this step as it appears in the transformation workspace. This name must be unique within a single transformation.

Connection

Select the drop-down menu to select the 'SAP HANA' database connection type. Note that this list is populated only once a database connection has already been established. If no database connection has been established, this list will be blank. Click the Edit, New, and Wizard icons to create or select a connection with the type 'SAP HANA'.

Target Schema

Enter the name of the schema for the table in to write data to. This field is important for data sources which allow for table names containing periods ('.') in them.

Target Table

Enter the name of the target table. Click the Browse button to view options.

File Configuration

• Local Files: Select this option to load data from locally stored files into the database table. If this option is selected, the Data File field displays.
• Remote Files: Select this option to load data contained in remotely stored files into the database table. If this option is selected, the VFS URL and Remote Data File fields appear.

Data File

When the Local Files option is selected, use this field to specify the variable which will name the file created by in the step, according to the mapping. This file will contain the data to be loaded into the database. Optionally, you can select the Browse button to search your system's local files.

VFS URL

When the Remote Files option is selected, enter the complete file path needed for accessing the files containing the data you want to import.

Note: The user should have access to the location specified in the Remote Data File field using the path provided here.

Remote Data File

When the Remote Files option is selected, use this field to specify the variable which will name the file created by the step, according to the mapping. This file will contain the data to be loaded into the database. Optionally, you can select the Browse button to search file locations.

Enable Logging

Select this check box to turn on error logging. When this check box is selected, the following fields are available for editing:

• Log Location: Enter the variable which will name the file you want to use to store the log of errors generated during the import process.
• Date / Time Format: Use the drop-down menu to select a date and time string to use for the error log. This string will be appended to the end of the file name of the log. It is recommended that you use a format which can be saved in the destination file system.

Table field

The name of the table column to be loaded in the SAP HANA table.

Stream field

The name of the field to be taken from the incoming rows.

Thread Count

Enter the number of threads to use for a concurrent import. This field is useful for achieving optimal performance by enabling parallel loading. In general, for column tables, the recommended setting is '10' for parallel loading threads. The maximum number for this field is '256'. Optionally, you can enter a system parameter instead of numbers.

Batch Size

Enter the number of records to be imported. This field is useful for achieving optimal performance. The recommended setting is '10,000'.
The minimum value for this field is '1'.  The maximum number for this field is '2,147,483,647'. 

Erase dat file after use

Select this check box to erase the data file (.dat) when the import is successfully completed.

Fail on invalid data

Select this check box to fail the import unless all the entries have imported successfully.

Type check

Select this check box if you want the system to check whether the data type is valid in each field before the record is imported. This type check is useful for achieving optimal performance. For example, you may want to select this option if you want to import a large file with little configuration. When this check box is cleared, the record will be inserted into the table without checking the data type of each field which may improve the performance of the import process.

Table lock

Select this check box to lock the target table such that no one can modify the table during the import process. Locking the table is useful for achieving optimal performance by potentially allowing for a faster import of column store tables.