Feature Selection Using Reinforcement Learning

2021-01-23 · Sali Rasoul, Sodiq Adewole, Alphonse Akakpo

With the decreasing cost of data collection, the space of variables or features that can be used to characterize a particular predictor of interest continues to grow exponentially. Therefore, identifying the most characterizing features that minimizes the variance without jeopardizing the bias of our models is critical to successfully training a machine learning model. In addition, identifying such features is critical for interpretability, prediction accuracy and optimal computation cost. While statistical methods such as subset selection, shrinkage, dimensionality reduction have been applied in selecting the best set of features, some other approaches in literature have approached feature selection task as a search problem where each state in the search space is a possible feature subset. In this paper, we solved the feature selection problem using Reinforcement Learning. Formulating the state space as a Markov Decision Process (MDP), we used Temporal Difference (TD) algorithm to select the best subset of features. Each state was evaluated using a robust and low cost classifier algorithm which could handle any non-linearities in the dataset.

📄 PDF Abstract BibTeX arXiv:2101.09460

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality Reductionfeature selectionreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Feature and Instance Joint Selection: A Reinforcement Learning Perspective

2022-05-12 · Wei Fan, Kunpeng Liu, Hao liu, HengShu Zhu 외

Feature selection and instance selection are two important techniques of data processing. However, such selections have mostly been studied separately, while existing work towards the joint selection conducts feature/ins…

Efficient Exploration feature selection reinforcement-learning Reinforcement Learning+1

Enhancing Classification Performance via Reinforcement Learning for Feature Selection

2024-03-09 · Younes Ghazagh Jahed, Seyyed Ali Sadat Tavana

Feature selection plays a crucial role in improving predictive accuracy by identifying relevant features while filtering out irrelevant ones. This study investigates the importance of effective feature selection in enhan…

Classification feature selection Q-Learning reinforcement-learning+2

StackFeat RL: Reinforcement Learning over Iterative Dual Criterion Feature Selection for Stable Biomarker Discovery

2026-04-24 · A. Yermekov, D. A. Herrera-Martí arxiv

Feature selection in high-dimensional genomic data ($d \gg n$) demands methods that are simultaneously accurate, sparse, and stable. Existing approaches either require manual threshold specification (mRMR, stability sele…

Reinforcement Learning

Interactive Reinforcement Learning for Feature Selection with Decision Tree in the Loop

2020-10-02 · Wei Fan, Kunpeng Liu, Hao liu, Yong Ge 외

We study the problem of balancing effectiveness and efficiency in automated feature selection. After exploring many feature selection methods, we observe a computational dilemma: 1) traditional feature selection is mostl…

Feature Importance feature selection reinforcement-learning Reinforcement Learning (RL)

Dynamic feature selection in medical predictive monitoring by reinforcement learning

2024-05-30 · Yutong Chen, Jiandong Gao, Ji Wu

In this paper, we investigate dynamic feature selection within multivariate time-series scenario, a common occurrence in clinical prediction monitoring where each feature corresponds to a bio-test result. Many existing f…

feature selection Prediction reinforcement-learning Reinforcement Learning+1