01_Big_Data_Preprocessing_Example
Big Data preprocessing
This workflow demonstrates the usage of the DB nodes in conjunction with the Create Local Big Data Environment node, which is part of the KNIME Big Data Extension. This node, together with the DB nodes, allows complex data preprocessing without the need of manual SQL coding.
To run this workflow on a remote cluster, use an HDFS Connection node and Hive Connector node (available in the KNIME Big Data Connectors Extension) in place of the Create Local Big Data Environment node.
The table name is controlled by a workflow variable which can be altered via the context menu of the workflow in the KNIME explorer.
Requirements:
- KNIME File Handling Nodes
- KNIME Extension for Local Big Data Environments
Nodes
- DB Reader (Labs)3 ×
- Database Connection Table Reader3 ×
- Create Local Big Data Environment1 ×
- Create Local Big Data Environment1 ×
- DB Column Filter (Labs)1 ×
- DB GroupBy (Labs)1 ×
- DB Joiner (Labs)1 ×
- DB Loader1 ×
- DB Row Filter (Labs)1 ×
- DB SQL Executor (Labs)1 ×
- DB Sorter (Labs)1 ×
- DB Table Creator1 ×
- DB Table Remover (Labs)1 ×
- DB Table Selector (Labs)1 ×
- Data Generator1 ×
- Database Column Filter1 ×
- Database Drop Table1 ×
- Database GroupBy1 ×
- Database Joiner1 ×
- Database Row Filter1 ×
- Database SQL Executor1 ×
- Database Sorter1 ×
- Database Table Selector1 ×
- Hive Loader1 ×
Extensions
- FeatureKNIME Base nodes
- FeatureKNIME Big Data Connectors
- FeatureKNIME Database
- FeatureKNIME Extension for Apache Spark
- FeatureKNIME Extension for Apache Spark (legacy)
Links
- No links available