Icon

Website usage data processing on Databricks

Website usage data are accessed from Databricks File System, processed and aggregated on a Databricks cluster and exported for further analysis

Website usage data processing on Databricks

Website usage data are accessed from Databricks File System, processed and aggregated on a Databricks cluster and exported for further analysis

Processing and aggregation of website usage data using Databricks cluster resources

Accessing website usage data from Databricks File System

Website usage data is a large table that contains for each session of each customer on the website: duration, clicks, likes, crashes, etc.

Exporting an aggregated website usage statistics table for further analytics

Remove irrelevant columns
DB Column Filter
Aggregate websiteusage statistics foreach customer
Spark GroupBy
Import into Spark DataFrame
Hive to Spark
Spark Column Rename
Connect to and starta Databricks cluster
Create Databricks Environment
Replace missingwebsite sessionsatisfaction scorewith an average score
Spark Missing Value
Free upresources
Destroy Spark Context
Access websiteusage data: for eachsession on the website:duration, clicks,likes, crashes, etc.
DB Table Selector (deprecated)
Load an aggregated websitestatistics usage table toKNIME for further analytics
Spark to Table

Nodes

Extensions

  • No modules found

Links