09_AzureExample
This workflow demonstrates how to connect to various Azure services such as HDInsight clusters, Azure Blob Storage, and AzureSQL from within KNIME Analytics Platform.
The Azure Blob Store Connection node connects KNIME Analytics Platform with your Azure Blob Storage and allows you to work with your files using the file handling nodes. The Azure Blob Store File Picker node creates a pre-signed URL that can be used in the reader nodes in KNIME to read directly from Azure Blob Storage or that can be shared with other users to access the dedicated files without the need for authentication.
The Create Spark Context (Livy) node can be used to set up a Spark context in your Azure HDInsight cluster. For more details see link to the documentation. Once a context is created you can use all the existing Spark nodes to visually assemble your Spark analysis flow.
Additionally, it is also possible to connect to Hive within your HDInsight cluster via the Hive Connector node.
The Microsoft SQL Server Connector node provides a DB Connection which can be used with the existing DB nodes to visually assemble queries that are executed within your AzureSQL. To upload large amounts of data into AzureSQL use the DB Loader node.
Nodes
- DB Loader2 ×
- DB Table Creator (Labs)2 ×
- Data Generator2 ×
- Azure Blob Store Connection1 ×
- Azure Blob Store File Picker1 ×
- Show all 16 nodes
Extensions
- FeatureKNIME Base nodes
- FeatureKNIME Basic File System Connectors
- FeatureKNIME Big Data Connectors
- FeatureKNIME Database
- FeatureKNIME Extension for Apache Spark
- Show all 6 modules