Icon

01_​Modelling_​Workflow

Continous Deployment - Modelling Workflow

This workflow is using Integrated Deployment in a complex Guided Analytics application hardcoded to work with a Churn Prediction dataset.

Workflow steps:
- access and blend the data
- perform data exploration
- prepare the data with normal nodes and an interactive view
- optimize, train and test two models
- retrain and test the interactively selected model
- generate a final training workflow
- generate a final deployment workflow from the training workflow
- deploy the workflow on KNIME Server

This workflow also works on KNIME WebPortal and its use case is simple churn prediction

Retrain on Full Dataset - retrain on full dataset the desired model with optimized parameters - predict on new test set and export workflow to be deployed / downloaded
Train and Optimize
Pre-processing - Join contract data and behavioral data - Convert Churn values to String to be used as class in upcoming classification - Reserve 80% of the rows for model training and remaining for model testing - Use same number of data rows for both classes in testing
test set
Reading and Blending - contract data + churn - behavioral (calls) data
train set
- Missing value imputation modelling - Optimize Random Forest parameters - Optimize threshold Binary Classification - Train model with optimized parameters - Capture branch to deploy
Capture for Deployment : Data Preparation
Churn = 0 : current subscriptions Churn = 1 : cancelled subscriptions
Data Exploration - automated visualization - uni- and bi-variate visual exploration
Domain Expertise Input - filter columns by quality - avoid ground truth leakage - column removal by domain knowledge
ML Expert Decision - asses performance - select best model
entire raw data set
DataPrep workflow
Chosen Retrain workflow
DataPrep workflow
ML Expert Decision - save training workflow - asses performance - select best model - save and deploy the model
Deployment workflow
Random Forest
Parameter Optimization RF
DB Table Selector
DB Connector
optimized model
XGBoost Tree Ensemble Learner
Workflow Combiner
KNIME Server Connection (legacy)
train: 90% test: 10%
Partitioning
Workflow Writer
Select Model
Deploy Workflow to Server
sub-sample 10%
Row Sampling
//
Capture Workflow Start
top: test set pred. middle: predictor workflow bottom: retrain workflow
Capture Workflow End
Deploy to Server
Workflow Writer
top: train set bottom: test set
Capture Workflow Start
Database URL and Credentials
optimized model
Random Forest Learner
Random Forest
Predictor RF
Area code and churn are converted to String.
Number to String
DB Reader
XGBoost
Predictor XGB
Domain Calculator
train: 99% test: 1%
Partitioning
//
Capture Workflow End
Reading ContractData.csv
File Reader (deprecated)
Automated Visualization
prepare raw data
Workflow Executor
XGBoost
Parameter Optimization XGB
Visualize and Download Model
Join the contract data and the behavioral data
Joiner (deprecated)
Capture Workflow Start
predictions test set both models
Joiner (deprecated)
Interactive Column Filter
Retrain: - chosen model - optimized model Deploy: - DataPrep - Predictor - within REST API
Workflow Executor
Capture Workflow End

Nodes

Extensions

Links