Icon

05_​Feature_​Selection_​solution

Feature Selection - solution

Introduction to Machine Learning Algorithms course - Session 4
Solution to exercise 5
- Combine previously splitted training and test set
- Search for the most important columns for classification using a feature selection loop


Exercise: Feature SelectionLet's take a look at which features are the most important in predicting the rank of a house. Below you see the workflow that we builtearlier in the course.1) Apply a forward feature selection algorithm to the trained model (Forward Feature Selection metanode)- Replace the Learner and Predictor nodes by the Logistic Regression Learner and Logistic Regression Predictor nodes in the workflow- Exclude the "rank" column in the Feature Selection Loop Start node- Select stratified sampling on the "rank" column in the Partitioning node- Select Cohen's kappa as the metric to maximize in the Feature Selection Loop End node- Take a look at the Feature Selection Filter node. Which columns can you leave out and still obtain the maximum Cohen's kappa? 2) Use the Reference Column Filter node to apply forward feature selection to the test set Start feature selection loop here Read AmesHousing.csvapply to the test set CSV Reader Missing ValueHandling Outlier Detection Preprocessing DimensionalityReduction Forward FeatureSelection ReferenceColumn Filter Exercise: Feature SelectionLet's take a look at which features are the most important in predicting the rank of a house. Below you see the workflow that we builtearlier in the course.1) Apply a forward feature selection algorithm to the trained model (Forward Feature Selection metanode)- Replace the Learner and Predictor nodes by the Logistic Regression Learner and Logistic Regression Predictor nodes in the workflow- Exclude the "rank" column in the Feature Selection Loop Start node- Select stratified sampling on the "rank" column in the Partitioning node- Select Cohen's kappa as the metric to maximize in the Feature Selection Loop End node- Take a look at the Feature Selection Filter node. Which columns can you leave out and still obtain the maximum Cohen's kappa? 2) Use the Reference Column Filter node to apply forward feature selection to the test set Start feature selection loop here Read AmesHousing.csvapply to the test set CSV Reader Missing ValueHandling Outlier Detection Preprocessing DimensionalityReduction Forward FeatureSelection ReferenceColumn Filter

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: Emilio Silvestri
Created at: 2019-11-29
On NodePit since: 2023-04-06
Last update: 2026-05-23
Created with KNIME version: v4.6.1
Tags: forward feature selectionclassificationlogistic regressioneducation

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!