Icon

Categorical Features Encoding--III

Amazon.com - Employee Access Challenge--Kaggle
Categorical Feature EngineeringData Source: Amazon.com - Employee Access Challenge https://www.kaggle.com/c/amazon-employee-access-challenge/dataDatset is not that big but all features are categorical with many levels. One Hot Encoding generates 15638 columns Without categorical feature encoding With categorical feature encoding f1-score: 0.177for minority classf1-score: 0.168for minority class5-folds80:20 stratifiedtrain data: 26215test data: 65540: 18971: 3087232769 X 10Target Col: ACTION Scorer Scorer X-Partitioner X-Aggregator Partitioning Value Counter Random ForestPredictor Tree EnsembleLearner Domain Calculator Table Reader Number To String Tree EnsembleLearner Tree EnsemblePredictor Auto CategoricalFeatures Embedding Categorical Feature EngineeringData Source: Amazon.com - Employee Access Challenge https://www.kaggle.com/c/amazon-employee-access-challenge/dataDatset is not that big but all features are categorical with many levels. One Hot Encoding generates 15638 columns Without categorical feature encoding With categorical feature encoding f1-score: 0.177for minority classf1-score: 0.168for minority class5-folds80:20 stratifiedtrain data: 26215test data: 65540: 18971: 3087232769 X 10Target Col: ACTION Scorer Scorer X-Partitioner X-Aggregator Partitioning Value Counter Random ForestPredictor Tree EnsembleLearner Domain Calculator Table Reader Number To String Tree EnsembleLearner Tree EnsemblePredictor Auto CategoricalFeatures Embedding

Nodes

Extensions

Links