This node uses database specific bulk loading functionality that only some databases
(e.g. Hive, MySQL, PostgreSQL and H2) support to load large amounts of data into an existing
database table.
Notice:
Most databases do not perform data checks when loading the data into the table which
might lead to a corrupt data table.
The node does some preliminary checks such as checking that the column order and column names are
compatible. However it does not check the column type compatibility. So before using this node please
make sure that the column types of the KNIME columns and the database columns are compatible.
Depending on the database an intermediate file format is often used for efficiency which might be required to upload the file to a server. If a file needs to be uploaded, any of the protocols supported by the file handling nodes can be used, e.g. for Apache Hive HDFS or webHDFS. After the loading of the data into a table, the uploaded file gets deleted if it is no longer needed by the database.
If there is no need to upload or store the file for any reason, a remote file input connection prevents execution.
Some databases such as MySQL and PostgreSQL support file based and memory based uploading which require different rights in the database. If this is the case and if you do not have the rights to execute the file based loading of the data try the memory based method instead. If supported the different modes can be changed in the Loader mode section of the "Options" tab which is otherwise hidden.
Depending on the connected database the dialog settings may change. For example, MySQL and PostgreSQL use a CSV file for the data transfer. In order to change how the CSV file is created go to the "Advanced" tab.
Popular Successors
- Wait...11 %
- Send Email9 %
- Hive to Spark8 %
- Timer Info7 %
- DB GroupBy7 %
- DB Query Reader5 %
- DB Row Filter5 %
- Active Branch Inverter3 %
- DB Query Extractor3 %
- Empty Table Switch3 %
DB Loader3 %- DB Update3 %
Database Update2 %- Rule-based Row Filter2 %
Table Row to Variable2 %- DB Column Rename (Regex)1 %
- String Manipulation (Variable)1 %
Flow Variable End IF1 %- DB SQL Executor1 %
- DB Column Filter1 %
- Hive Connector1 %
- URL to File Path (Variable)< 1 %
- Duplicate Row Filter< 1 %
- DB Connector< 1 %
- DB Reader< 1 %
- DB Pivot< 1 %
Merge Variables< 1 %- DB Query< 1 %
- DB Partitioning< 1 %
- Column Expressions< 1 %
- Variable Expressions< 1 %
- Python Source (legacy)< 1 %
- POST Request< 1 %
Variable to Table Row< 1 %Loop End< 1 %- Impala to Spark< 1 %
- Spark SQL Query< 1 %
- DB Connection Closer< 1 %
- Parameterized DB Query Reader< 1 %
- DB Joiner< 1 %
- DB Table Selector< 1 %
- URL to File Path< 1 %
- Catch Errors (Var Ports)< 1 %
Variable to Table Row< 1 %CSV Writer< 1 %Database Table Selector< 1 %Variable Loop End< 1 %- One to Many< 1 %
- Column Filter< 1 %
- Row Filter< 1 %
- DB to Spark< 1 %
- MySQL Connector< 1 %
- DB Connection Table Writer< 1 %
- DB Connection Extractor< 1 %
- DB Insert< 1 %
- DB Writer< 1 %
- DB Column Rename< 1 %
- DB Sorter< 1 %
Excel Writer (XLS)< 1 %- Delete Files (legacy)< 1 %
- Unzip Files (legacy)< 1 %
Variable Condition Loop End< 1 %- End IF< 1 %
MySQL Connector< 1 %- DB Type Mapper< 1 %
Views
- This node has no views
Workflows
01_Big_Data_Preprocessing_ExampleKNIME Hub- 01_Big_Data_Preprocessing_ExampleKNIME Hub
- 01_Flight_Delay_StatisticsKNIME Hub
- 01_Flight_Delay_Statistics_ImpalaKNIME Hub
- 04_GoogleCloudExampleKNIME Hub
- Show all 32 workflows
Links
- No links available
Developers
You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.