Data loading

Recent versions of MonetDB have a problem with "INSERT INTO" SQL statements. Load operations work fine for a few hundred thousand to a million rows, but abort on some random time.

Fortunately, MonetDB offers excellent performance with bulk load operations. This is the syntax of the "COPY INTO" bulk load command:


     COPY [ <int_val>  [ OFFSET <int_val>] RECORDS ]
     INTO <table_name> FROM source_location
        [ [USING] DELIMITERS
                tuple_seperator [','
                record_seperator [ ','
                string_quote ]]]
        [ NULL AS null_string ]
     
     source_location:
        ( <file_name>, ... )
      | STDIN

The availability of this command allowed us to write an experimental bulk loader in 3.1.0GA that we hopefully can bring to a stable state in the next release (3.2).