This node uses database specific bulk loading functionality that only some databases
(e.g. Hive, MySQL, PostgreSQL and H2) support to load large amounts of data into an existing
database table.
Notice:
Most databases do not perform data checks when loading the data into the table which
might lead to a corrupt data table.
The node does some preliminary checks such as checking that the column order and column names are
compatible. However it does not check the column type compatibility. So before using this node please
make sure that the column types of the KNIME columns and the database columns are compatible.
Depending on the database an intermediate file format is often used for efficiency which might be required to upload the file to a server. If a file needs to be uploaded, any of the protocols supported by the file handling nodes can be used, e.g. for Apache Hive HDFS or webHDFS. After the loading of the data into a table, the uploaded file gets deleted if it is no longer needed by the database.
If there is no need to upload or store the file for any reason, a remote file input connection prevents execution.
Some databases such as MySQL and PostgreSQL support file based and memory based uploading which require different rights in the database. If this is the case and if you do not have the rights to execute the file based loading of the data try the memory based method instead. If supported the different modes can be changed in the Loader mode section of the "Options" tab which is otherwise hidden.
Depending on the connected database the dialog settings may change. For example, MySQL and PostgreSQL use a CSV file for the data transfer. In order to change how the CSV file is created go to the "Advanced" tab.
Popular Predecessors
- Legacy Date&Time to Date&Time6 %
- Cache4 %
- Reference Row Filter3 %
Database Reader2 %- String Manipulation (Variable)2 %
- DB Query Extractor2 %
- Wait...2 %
- DB Insert2 %
- Amazon Redshift Connector2 %
Row Filter (deprecated)2 %DB Loader2 %- HttpFS Connection (legacy)2 %
- Table View (JavaScript)2 %
Extract Date&Time Fields2 %Excel Reader (XLS)1 %Table Reader1 %- Chunk Loop Start1 %
- Column Rename (Regex)1 %
- Impala Connector1 %
- MySQL Connector1 %
- DB Delete (Table)1 %
- DB Query Reader1 %
- DB SQL Executor1 %
- DB Loader1 %
CSV Reader1 %- Reference Column Filter1 %
- String Manipulation1 %
- DB Writer1 %
- Variable Loop End1 %
Row Splitter (deprecated)< 1 %- Partitioning< 1 %
- DB Reader< 1 %
File Reader< 1 %List Files< 1 %- Table Creator< 1 %
- Concatenate< 1 %
- Column Auto Type Cast< 1 %
- String to Number< 1 %
- Column Resorter< 1 %
- Constant Value Column< 1 %
- Column Filter< 1 %
- GroupBy< 1 %
Joiner< 1 %- Missing Value< 1 %
- Reference Column Resorter< 1 %
Column Rename< 1 %- HDFS Connection (legacy)< 1 %
- Secured HttpFS Connection (legacy)< 1 %
- WebHDFS Connection (legacy)< 1 %
- Microsoft Access Connector< 1 %
- Oracle Connector< 1 %
- PostgreSQL Connector< 1 %
- DB Merge< 1 %
- DB Table Remover< 1 %
DB Table Creator< 1 %- Column Expressions (legacy)< 1 %
Excel Reader (XLS)< 1 %- Date&Time to String< 1 %
- CSV Reader< 1 %
- Joiner< 1 %
- DB Table Creator< 1 %
- Excel Reader< 1 %
- HTTPS Connection (legacy)< 1 %
- URI to String< 1 %
Variable Condition Loop End< 1 %- Cross Joiner< 1 %
- Google BigQuery Connector< 1 %
- Parameterized DB Query Reader< 1 %
- DB Transaction Start< 1 %
- Empty Table Creator< 1 %
Python Script (2⇒2)< 1 %CSV Writer< 1 %- Number to String< 1 %
- Duplicate Row Filter< 1 %
- Number Rounder< 1 %
- Rule-based Row Splitter< 1 %
- Timer Info< 1 %
- Secure WebHDFS via KNOX Connection (legacy)< 1 %
- Secured WebHDFS Connection (legacy)< 1 %
- SQLite Connector< 1 %
- Math Formula< 1 %
- Date&Time to legacy Date&Time< 1 %
- String to Date&Time< 1 %
- Loop End (Column Append)< 1 %
- Double to Integer< 1 %
- Pivot< 1 %
- RowID< 1 %
- Rule-based Row Filter< 1 %
- Rule Engine< 1 %
- Amazon S3 File Picker (legacy)< 1 %
- Microsoft SQL Server Connector< 1 %
- GET Request< 1 %
- Modify Time< 1 %
- KNIME Server Connection (legacy)< 1 %
Flow Variable IF Switch< 1 %- FTP Connection (legacy)< 1 %
- SSH Connection (legacy)< 1 %
- Try (Data Ports)< 1 %
- Try (Variable Ports)< 1 %
- Active Branch Inverter< 1 %
Table Row to Variable< 1 %Database Looping< 1 %Line Reader< 1 %Line Reader< 1 %Loop End< 1 %Counting Loop Start< 1 %Variable Loop End< 1 %- Category to Number< 1 %
- Column Renamer (Dictionary)< 1 %
- Table Validator< 1 %
- Table Validator (Reference)< 1 %
- Row Sampling< 1 %
- Sorter< 1 %
- Data Generator< 1 %
- Hive Connector< 1 %
ORC Reader< 1 %Parquet Reader< 1 %- Spark to Table< 1 %
- Amazon Athena Connector< 1 %
- H2 Connector< 1 %
- DB Connector< 1 %
- DB Update< 1 %
- Math Formula (Multi Column)< 1 %
- SAS7BDAT Reader< 1 %
- Java Snippet (simple)< 1 %
- Google Sheets Reader< 1 %
- String Input (legacy)< 1 %
- Table Editor (JavaScript)< 1 %
Python Script (1⇒1)< 1 %Python Script (2⇒1)< 1 %- UNIX Timestamp to Date&Time< 1 %
- Date&Time Shift< 1 %
- XPath< 1 %
- Database List Tables (Legacy)< 1 %
- Create Collection Column< 1 %
- File Meta Info (legacy)< 1 %
- Distance Matrix Pair Extractor< 1 %
- Numeric Binner< 1 %
- Column Aggregator< 1 %
- String Manipulation (Multi Column)< 1 %
- Empty Table Switch< 1 %
- DB Connection Table Writer< 1 %
Read Excel Sheet Names (XLS)< 1 %- Date&Time-based Row Filter< 1 %
Views
- This node has no views
Workflows
01_Big_Data_Preprocessing_ExampleKNIME Hub- 01_Big_Data_Preprocessing_ExampleKNIME Hub
- 01_Flight_Delay_StatisticsKNIME Hub
- 01_Flight_Delay_Statistics_ImpalaKNIME Hub
- 06_Connecting_to_DatabricksKNIME Hub
- Show all 30 workflows
Links
- No links available
Developers
You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.