Are screening methods useful in feature selection? An empirical study
Filter or screening methods are often used as a preprocessing step for reducing the number of variables used by a learning algorithm in obtaining a classification or regression model. While there are many such filter methods, there is a need for an objective evaluation of these methods. Such an evaluation is needed to compare them with each other and also to answer whether they are at all useful, or a learning algorithm could do a better job without them. For this purpose, many popular screening methods are partnered in this paper with three regression learners and five classification learners and evaluated on ten real datasets to obtain accuracy criteria such as R-square and area under the ROC curve (AUC). The obtained results are compared through curve plots and comparison tables in order to find out whether screening methods help improve the performance of learning algorithms and how they fare with each other. Our findings revealed that the screening methods were useful in improving the prediction of the best learner on two regression and two classification datasets out of the ten datasets evaluated.
Code (0)
등록된 구현이 없습니다.
Tasks
Classificationfeature selectionGeneral ClassificationregressionSimilar Papers 제목 키워드 기반
On the consistency theory of high dimensional variable screening
Variable screening is a fast dimension reduction technique for assisting high dimensional feature selection. As a preselection method, it selects a moderate size subset of candidate variables for further refining via fea…
Computational EfficiencyDimensionality Reductionfeature selectionVocal Bursts Intensity PredictionOnline Feature Screening for Data Streams with Concept Drift
Screening feature selection methods are often used as a preprocessing step for reducing the number of variables before training step. Traditional screening methods only focus on dealing with complete high dimensional dat…
Feature Importancefeature selectionThe use of cross validation in the analysis of designed experiments
Cross-validation (CV) is a common method to tune machine learning methods and can be used for model selection in regression as well. Because of the structured nature of small, traditional experimental designs, the litera…
Model SelectionA Multimodal Data-driven Framework for Anxiety Screening
Early screening for anxiety and appropriate interventions are essential to reduce the incidence of self-harm and suicide in patients. Due to limited medical resources, traditional methods that overly rely on physician ex…
Dimensionality Reductionfeature selectionSafe Active Feature Selection for Sparse Learning
We present safe active incremental feature selection~(SAIF) to scale up the computation of LASSO solutions. SAIF does not require a solution from a heavier penalty parameter as in sequential screening or updating the ful…
feature selectionSparse Learning