Large-scale Multi-objective Feature Selection: A Multi-phase Search Space Shrinking Approach
Feature selection is a crucial step in machine learning, especially for high-dimensional datasets, where irrelevant and redundant features can degrade model performance and increase computational costs. This paper proposes a novel large-scale multi-objective evolutionary algorithm based on the search space shrinking, termed LMSSS, to tackle the challenges of feature selection particularly as a sparse optimization problem. The method includes a shrinking scheme to reduce dimensionality of the search space by eliminating irrelevant features before the main evolutionary process. This is achieved through a ranking-based filtering method that evaluates features based on their correlation with class labels and frequency in an initial, cost-effective evolutionary process. Additionally, a smart crossover scheme based on voting between parent solutions is introduced, giving higher weight to the parent with better classification accuracy. An intelligent mutation process is also designed to target features prematurely excluded from the population, ensuring they are evaluated in combination with other features. These integrated techniques allow the evolutionary process to explore the search space more efficiently and effectively, addressing the sparse and high-dimensional nature of large-scale feature selection problems. The effectiveness of the proposed algorithm is demonstrated through comprehensive experiments on 15 large-scale datasets, showcasing its potential to identify more accurate feature subsets compared to state-of-the-art large-scale feature selection algorithms. These results highlight LMSSS's capability to improve model performance and computational efficiency, setting a new benchmark in the field.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational Efficiencyfeature selectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multi-objective Binary Coordinate Search for Feature Selection
A supervised feature selection method selects an appropriate but concise set of features to differentiate classes, which is highly expensive for large-scale datasets. Therefore, feature selection should aim at both minim…
feature selectionREFRESH: Responsible and Efficient Feature Reselection Guided by SHAP Values
Feature selection is a crucial step in building machine learning models. This process is often achieved with accuracy as an objective, and can be cumbersome and computationally expensive for large-scale datasets. Several…
Fairnessfeature selectionPoint Cloud Objective Quality: Benchmarking Features and Quality Evaluation
Full-reference point cloud objective metrics are currently providing very accurate representations of perceptual quality. These metrics are usually composed of a set of features that are somehow combined, resulting in a …
AttributeBenchmarkingfeature selectionGraph Similarity+1Automatic multi-objective based feature selection for classification
Objective: Accurately classifying the malignancy of lesions detected in a screening scan is critical for reducing false positives. Radiomics holds great potential to differentiate malignant from benign tumors by extracti…
Classificationfeature selectionGeneral ClassificationSpecificityMOFSRank: A Multiobjective Evolutionary Algorithm for Feature Selection in Learning to Rank
Learning to rank has attracted increasing interest in the past decade, due to its wide applications in the areas like document retrieval and collaborative filtering. Feature selection for learning to rank is to select a…
Collaborative Filteringfeature selectionLearning-To-Rank