Icon

01_​Big_​Data_​Connectors

11 workflows in this folder and its subfolders

Icon
01_​Big_​Data_​Preprocessing_​Example

January 2020 · This workflow demonstrates the usage of the DB nodes in conjunction with the Create Local Big Data Environment node, which is part of the KNIME Big Data Extension. This node, together with the DB nodes, allows complex data preprocessing without the need of manual SQL coding. To run this workflow on…

Icon
02_​HDFS_​and_​File_​Handling_​Example

January 2020 · This workflow demonstrates the HDFS file handling capabilites using the file handling nodes in conjunction with an HDFS connection. To run this workflow on a remote cluster, use an HDFS Connection node (available in the KNIME Big Data Connectors Extension) in place of the Create Local Big Data Envir…

Icon
03_​DatabricksExample

January 2020 · This workflow demonstrates the usage of the Create Databricks Environment node which allows you to connect to a Databricks Cluster from within KNIME Analystics Platform. The node provides three output ports that allow you to utilize the existing DB nodes to interact wtih the Databricks DB, the file…

Icon
04_​GoogleCloudExample

December 2019 · URL: Google Cloud Dataproc https://cloud.google.com/dataproc/ URL: Apache Livy Initialization Action https://github.com/GoogleCloudPlatform/dataproc-initialization-actions/tree/master/livy URL: Google BigQuery https://cloud.google.com/bigquery/ URL: Google Cloud Storage https://cloud.google.com/stor…

Icon
05_​Austin bike sharing with Google BigQuery

January 2020 · URL: Tutorial: Importing Data from Google BigQuery https://www.knime.com/blog/tutorial-importing-data-from-google-bigquery

Icon
06_​Connecting_​to_​Databricks

March 2020 · This workflow shows how to connect to a Databricks cluster and utilize various KNIME nodes to interact with Databricks from within KNIME Analytics Platform. URL: KNIME on Databricks - A Guide https://www.knime.com/blog/knime-on-databricks-guide

Icon
07_​Will_​They_​Blend_​BigQuery_​Databricks

January 2020 · Google BigQuery meets Databricks This workflow connects to the Austin Bikeshare dataset, hosted among the Google BigQuery public datasets and a Databricks instance hosting the Austin Weather dataset. It first performs custom queries on the two platforms, then data are imported into the workflow and…

Icon
08_​Connecting_​to_​Amazon_​EMR

July 2020 · Connecting to Amazon EMR This workflow demonstrates how to create a Spark context via Apache Livy and execute a simple Spark job on an Amazon EMR cluster. This example uses the NYC taxi dataset from the AWS Registry of Open Data to build a simple prediction model with Random Forest. Additionally, th…

Icon
09_​AzureExample

September 2020 · This workflow demonstrates how to connect to various Azure services such as HDInsight clusters, Azure Blob Storage, and AzureSQL from within KNIME Analytics Platform. The Azure Blob Store Connection node connects KNIME Analytics Platform with your Azure Blob Storage and allows you to work with your…

Icon
10_​Connecting_​to_​SMB

June 2021 · Operations on remote File System using SMB Connector This workflow connects to a remote File System using the SMB Connector node. It performs some basic read/write and compress/decompress operation on the remote host. URL: KNIME File Handling Guide https://docs.knime.com/latest/analytics_platform_fi…