Conformal Recursive Feature Elimination
Unlike traditional statistical methods, Conformal Prediction (CP) allows for the determination of valid and accurate confidence levels associated with individual predictions based only on exchangeability of the data. We here introduce a new feature selection method that takes advantage of the CP framework. Our proposal, named Conformal Recursive Feature Elimination (CRFE), identifies and recursively removes features that increase the non-conformity of a dataset. We also present an automatic stopping criterion for CRFE, as well as a new index to measure consistency between subsets of features. CRFE selections are compared to the classical Recursive Feature Elimination (RFE) method on several multiclass datasets by using multiple partitions of the data. The results show that CRFE clearly outperforms RFE in half of the datasets, while achieving similar performance in the rest. The automatic stopping criterion provides subsets of effective and non-redundant features without computing any classification performance.
Code (1)
Tasks
Conformal Predictionfeature selectionvalidMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Fibonacci and k-Subsecting Recursive Feature Elimination
Feature selection is a data mining task with the potential of speeding up classification algorithms, enhancing model comprehensibility, and improving learning accuracy. However, finding a subset of features that is optim…
feature selectionLower Limb Movements Recognition Based on Feature Recursive Elimination and Backpropagation Neural Network
Surface electromyographic (sEMG) signal serve as a signal source commonly used for lower limb movement recognition, reflecting the intent of human movement. However, it has been a challenge to improve the movements recog…
Action Recognitionfeature selectionFeature Elimination in Kernel Machines in moderately high dimensions
We develop an approach for feature elimination in statistical learning with kernel machines, based on recursive elimination of features.We present theoretical properties of this method and show that it is uniformly consi…
Vocal Bursts Intensity PredictionCardiovascular Disease Prediction using Recursive Feature Elimination and Gradient Boosting Classification Techniques
Cardiovascular diseases (CVDs) are one of the most common chronic illnesses that affect peoples health. Early detection of CVDs can reduce mortality rates by preventing or reducing the severity of the disease. Machine le…
BIG-bench Machine LearningDisease PredictionAn explainable Recursive Feature Elimination to detect Advanced Persistent Threats using Random Forest classifier
Intrusion Detection Systems (IDS) play a vital role in modern cybersecurity frameworks by providing a primary defense mechanism against sophisticated threat actors. In this paper, we propose an explainable intrusion dete…
Intrusion Detection