홈 › Papers

Reinforcement Learning with Efficient Active Feature Acquisition

2020-11-02 · NeurIPS Workshop LMCA 2020 12 · Haiyan Yin, Yingzhen Li, Sinno Jialin Pan, Cheng Zhang, Sebastian Tschiatschek

Solving real-life sequential decision making problems under partial observability involves an exploration-exploitation problem. To be successful, an agent needs to efficiently gather valuable information about the state of the world for making rewarding decisions. However, in real-life, acquiring valuable information is often highly costly, e.g., in the medical domain, information acquisition might correspond to performing a medical test on a patient. This poses a significant challenge for the agent to perform optimally for the task while reducing the cost for information acquisition. In this paper, we propose a model-based reinforcement learning framework that learns an active feature acquisition policy to solve the exploration-exploitation problem during its execution. Key to the success is a novel sequential variational auto-encoder that learns high-quality representations from partially observed states, which are then used by the policy to maximize the task reward in a cost efficient manner. We demonstrate the efficacy of our proposed framework in a control domain as well as using a medical simulator. In both tasks, our proposed method outperforms conventional baselines and results in policies with greater cost efficiency.

📄 PDF Abstract BibTeX arXiv:2011.00825

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingModel-based Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Sequential Decision Making

Evaluation of Active Feature Acquisition Methods for Time-varying Feature Settings

2023-12-03 · Henrik von Kleist, Alireza Zamanian, Ilya Shpitser, Narges Ahmidi

Machine learning methods often assume that input features are available at no cost. However, in domains like healthcare, where acquiring features could be expensive or harmful, it is necessary to balance a feature's acqu…

AI Agent reinforcement-learning Reinforcement Learning

Why Pay More When You Can Pay Less: A Joint Learning Framework for Active Feature Acquisition and Classification

2017-09-18 · Hajin Shim, Sung Ju Hwang, Eunho Yang

We consider the problem of active feature acquisition, where we sequentially select the subset of features in order to achieve the maximum prediction performance in the most cost-effective way. In this work, we formulate…

General Classification Reinforcement Learning Reinforcement Learning (RL)

Stochastic Encodings for Active Feature Acquisition

2025-08-03 · Alexander Norcliffe, Changhee Lee, Fergus Imrie, Mihaela van der Schaar 외 arxiv

Active Feature Acquisition is an instance-wise, sequential decision making problem. The aim is to dynamically select which feature to measure based on current observations, independently for each test instance. Common ap…

Reinforcement Learning Decision Making

Evaluation of Active Feature Acquisition Methods for Static Feature Settings

2023-12-06 · Henrik von Kleist, Alireza Zamanian, Ilya Shpitser, Narges Ahmidi

Active feature acquisition (AFA) agents, crucial in domains like healthcare where acquiring features is often costly or harmful, determine the optimal set of features for a subsequent classification task. As deploying an…

Offline RL reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Information Templates: A New Paradigm for Intelligent Active Feature Acquisition

2025-08-25 · Hung-Tien Huang, Dzung Dinh, Junier B. Oliva arxiv

Active feature acquisition (AFA) is an instance-adaptive paradigm in which, at inference time, a policy sequentially chooses which features to acquire (at a cost) before predicting. Existing approaches either train reinf…

Reinforcement Learning