Icon

Hive over hdfs

Using hive over hdfs

This workflow demonstrates a) how to save a csv file in hdfs and access it, b) how to connect to hiveserver2, c) how to create a table, d) how to populate table and d) how to query table.

# Last amended: 22nd Dec, 2022Using hive over hdfs file system Right click on CSV Writer/Reader to Add Filesystem connection ports Query data tableRt click and firstAdd File system portPopulate tablecreated beforehandRead 'Table' file from hdfscreates a blank tableRead a csv filefrom linux file sysWrite file tohdfs in 'Table'formatGeneratehdfscontextFirst, at console, start hiveserver2 asa service. Then use this nodeto connect to hiveserver atport 10000. Database 'abc' must already existset hdfs filesystem permissionsRead CSV filesfrom hadoopWrite csv fileto hadoopNode 75Node 76 DB Table Selector DB Loader Table Reader DB Table Creator CSV Reader Table Writer HDFS Connector Hive Connector Set Files/FoldersPermissions CSV Reader CSV Writer DB Table Selector DB Query Reader # Last amended: 22nd Dec, 2022Using hive over hdfs file system Right click on CSV Writer/Reader to Add Filesystem connection ports Query data tableRt click and firstAdd File system portPopulate tablecreated beforehandRead 'Table' file from hdfscreates a blank tableRead a csv filefrom linux file sysWrite file tohdfs in 'Table'formatGeneratehdfscontextFirst, at console, start hiveserver2 asa service. Then use this nodeto connect to hiveserver atport 10000. Database 'abc' must already existset hdfs filesystem permissionsRead CSV filesfrom hadoopWrite csv fileto hadoopNode 75Node 76DB Table Selector DB Loader Table Reader DB Table Creator CSV Reader Table Writer HDFS Connector Hive Connector Set Files/FoldersPermissions CSV Reader CSV Writer DB Table Selector DB Query Reader

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: Maarit Laukkanen
Created at: 2021-03-11
On NodePit since: 2022-12-22
Last update: 2024-11-18
Created with KNIME version: v4.7.0
Tags: big datasparkhive

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!