0 ×

01_​Big_​Data_​Preprocessing_​Example

Workflow

Big Data preprocessing
HiveHadoopBig DataSQLin-database
Create Table Big Data Preprocessing Please run the branches below in order for best results: Create Table --> Process Data --> Drop Table.For more information see the workflow metadata. Find it here: View -> Description Process Data Drop Table Sample Dataset execution engineto tezdrop test table(execute last)select the created tablekeep only Iris-versicolorcalculatestatisticsremovecluster membershipjoin original datawith aggregated datasort byuniverse_0_0ascendingcreate the demo tableload thedemo table Data Generator DB SQL Executor DB Table Remover DB Table Selector DB Row Filter DB GroupBy DB Column Filter DB Joiner DB Reader DB Sorter DB Reader DB Reader DB Table Creator Create Local BigData Environment DB Loader Create Temp Folder Create Table Big Data Preprocessing Please run the branches below in order for best results: Create Table --> Process Data --> Drop Table.For more information see the workflow metadata. Find it here: View -> Description Process Data Drop Table Sample Dataset execution engineto tezdrop test table(execute last)select the created tablekeep only Iris-versicolorcalculatestatisticsremovecluster membershipjoin original datawith aggregated datasort byuniverse_0_0ascendingcreate the demo tableload thedemo table Data Generator DB SQL Executor DB Table Remover DB Table Selector DB Row Filter DB GroupBy DB Column Filter DB Joiner DB Reader DB Sorter DB Reader DB Reader DB Table Creator Create Local BigData Environment DB Loader Create Temp Folder

Download

Get this workflow from the following link: Download

Nodes

01_​Big_​Data_​Preprocessing_​Example consists of the following 45 nodes(s):

Plugins

01_​Big_​Data_​Preprocessing_​Example contains nodes provided by the following 5 plugin(s):