Enhancing Classification Performance via Reinforcement Learning for Feature Selection

2024-03-09 · Younes Ghazagh Jahed, Seyyed Ali Sadat Tavana

Feature selection plays a crucial role in improving predictive accuracy by identifying relevant features while filtering out irrelevant ones. This study investigates the importance of effective feature selection in enhancing the performance of classification models. By employing reinforcement learning (RL) algorithms, specifically Q-learning (QL) and SARSA learning, this paper addresses the feature selection challenge. Using the Breast Cancer Coimbra dataset (BCCDS) and three normalization methods (Min-Max, l1, and l2), the study evaluates the performance of these algorithms. Results show that QL@Min-Max and SARSA@l2 achieve the highest classification accuracies, reaching 87% and 88%, respectively. This highlights the effectiveness of RL-based feature selection methods in optimizing classification tasks, contributing to improved model accuracy and efficiency.

📄 PDF Abstract BibTeX arXiv:2403.05979

Code (0)

등록된 구현이 없습니다.

Tasks

Classificationfeature selectionQ-Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Sarsa Sarsa is an on-policy TD control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} + \gamma{Q}\left(S\_{t+1},…

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Feature Selection for Latent Factor Models

2024-12-13 · CVPR 2025 1 · Rittwika Kansabanik, Adrian Barbu

Feature selection is crucial for pinpointing relevant features in high-dimensional datasets, mitigating the 'curse of dimensionality,' and enhancing machine learning performance. Traditional feature selection methods for…

feature selection

Demonstration Selection for In-Context Learning via Reinforcement Learning

2024-12-05 · Xubin Wang, Jianfei Wu, Yichen Yuan, Mingzhe Li 외

Diversity in demonstration selection is crucial for enhancing model generalization, as it enables a broader coverage of structures and concepts. However, constructing an appropriate set of demonstrations has remained a f…

Classification Diversity In-Context Learning Q-Learning+4

BoMGene: Integrating Boruta-mRMR feature selection for enhanced Gene expression classification

2025-10-01 · Bich-Chung Phan, Thanh Ma, Huu-Hoa Nguyen, Thanh-Nghi Do arxiv

Feature selection is a crucial step in analyzing gene expression data, enhancing classification performance, and reducing computational costs for high-dimensional datasets. This paper proposes BoMGene, a hybrid feature s…

Causal Feature Selection with Dimension Reduction for Interpretable Text Classification

2020-10-09 · Guohou Shan, James Foulds, SHimei Pan

Text features that are correlated with class labels, but do not directly cause them, are sometimesuseful for prediction, but they may not be insightful. As an alternative to traditional correlation-basedfeature selection…

Causal Inference Classification Dimensionality Reduction Document Classification+4

Learning How to Self-Learn: Enhancing Self-Training Using Neural Reinforcement Learning

2018-04-16 · Chenhua Chen, Yue Zhang

Self-training is a useful strategy for semi-supervised learning, leveraging raw texts for enhancing model performances. Traditional self-training methods depend on heuristics such as model confidence for instance selecti…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)