Active Reinforcement Learning: Observing Rewards at a Cost
Active reinforcement learning (ARL) is a variant on reinforcement learning where the agent does not observe the reward unless it chooses to pay a query cost c > 0. The central question of ARL is how to quantify the long-term value of reward information. Even in multi-armed bandits, computing the value of this information is intractable and we have to rely on heuristics. We propose and evaluate several heuristic approaches for ARL in multi-armed bandits and (tabular) Markov decision processes, and discuss and illustrate some challenging aspects of the ARL problem.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Armed Banditsreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Actively Learning Costly Reward Functions for Reinforcement Learning
Transfer of recent advances in deep reinforcement learning to real-world applications is hindered by high data demands and thus low efficiency and scalability. Through independent improvements of components such as repla…
Active LearningDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1Evolution of Fear and Social Rewards in Prey-Predator Relationship
Fear is a critical brain function that enables us to learn to avoid danger via reinforcement learning (RL). While many researchers have argued that fear has evolved to escape predators, how varying predatory pressures ha…
Reinforcement LearningThe Value of Reward Lookahead in Reinforcement Learning
In reinforcement learning (RL), agents sequentially interact with changing environments while aiming to maximize the obtained rewards. Usually, rewards are observed only after acting, and so the goal is to maximize the e…
Offline RLreinforcement-learningReinforcement LearningReinforcement Learning (RL)Deep Reinforcement Fuzzing
Fuzzing is the process of finding security vulnerabilities in input-processing code by repeatedly testing the code with modified inputs. In this paper, we formalize fuzzing as a reinforcement learning problem using the c…
Q-Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Deep Interactive Reinforcement Learning for Path Following of Autonomous Underwater Vehicle
Autonomous underwater vehicle (AUV) plays an increasingly important role in ocean exploration. Existing AUVs are usually not fully autonomous and generally limited to pre-planning or pre-programming tasks. Reinforcement …
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)