Feature Selection Based on Confidence Machine
In machine learning and pattern recognition, feature selection has been a hot topic in the literature. Unsupervised feature selection is challenging due to the loss of labels which would supply the related information.How to define an appropriate metric is the key for feature selection. We propose a filter method for unsupervised feature selection which is based on the Confidence Machine. Confidence Machine offers an estimation of confidence on a feature'reliability. In this paper, we provide the math model of Confidence Machine in the context of feature selection, which maximizes the relevance and minimizes the redundancy of the selected feature. We compare our method against classic feature selection methods Laplacian Score, Pearson Correlation and Principal Component Analysis on benchmark data sets. The experimental results demonstrate the efficiency and effectiveness of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
feature selectionMathSimilar Papers 제목 키워드 기반
Confidence-Based Model Selection: When to Take Shortcuts for Subpopulation Shifts
Effective machine learning models learn both robust features that directly determine the outcome of interest (e.g., an object with wheels is more likely to be a car), and shortcut features (e.g., an object on a road is m…
Model SelectionPost-Selection Confidence Bounds for Prediction Performance
In machine learning, the selection of a promising model from a potentially large number of competing models and the assessment of its generalization performance are critical tasks that need careful consideration. Typical…
Model SelectionPredictionvalidRankMatch: Fostering Confidence and Consistency in Learning with Noisy Labels
Learning with noisy labels (LNL) is one of the most important and challenging problems in weakly-supervised learning. Recent advances adopt the sample selection strategy to mitigate the interference of noisy labels a…
Learning with noisy labelsRepresentation LearningWeakly-supervised LearningGrammatical Error Correction Using Feature Selection and Confidence Tuning
Large-scale Online Feature Selection for Ultra-high Dimensional Sparse Data
Feature selection with large-scale high-dimensional data is important yet very challenging in machine learning and data mining. Online feature selection is a promising new paradigm that is more efficient and scalable tha…
feature selectionVocal Bursts Intensity Prediction