paper-with-me

Papers

Learning to Explore and Exploit in POMDPs

2009-12-01 · NeurIPS 2009 12 · Chenghui Cai, Xuejun Liao, Lawrence Carin

A fundamental objective in reinforcement learning is the maintenance of a proper balance between exploration and exploitation. This problem becomes more challenging when the agent can only partially observe the states of its environment. In this paper we propose a dual-policy method for jointly learning the agent behavior and the balance between exploration exploitation, in partially observable environments. The method subsumes traditional exploration, in which the agent takes actions to gather information about the environment, and active learning, in which the agent queries an oracle for optimal actions (with an associated cost for employing the oracle). The form of the employed exploration is dictated by the specific problem. Theoretical guarantees are provided concerning the optimality of the balancing of exploration and exploitation. The effectiveness of the method is demonstrated by experimental results on benchmark problems.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningReinforcement Learning

Similar Papers 제목 키워드 기반

Individual Planning in Infinite-Horizon Multiagent Settings: Inference, Structure and Scalability

2015-12-01 · NeurIPS 2015 12 · Xia Qu, Prashant Doshi

This paper provides the first formalization of self-interested planning in multiagent settings using expectation-maximization (EM). Our formalization in the context of infinite-horizon and finitely-nest…

Learning in POMDPs with Monte Carlo Tree Search

2018-06-14 · ICML 2017 8 · Sammie Katt, Frans A. Oliehoek, Christopher Amato

The POMDP is a powerful framework for reasoning under outcome and information uncertainty, but constructing an accurate POMDP model is difficult. Bayes-Adaptive Partially Observable Markov Decision Processes (BA-POMDPs) …

rho-POMDPs have Lipschitz-Continuous epsilon-Optimal Value Functions

2018-12-01 · NeurIPS 2018 12 · Mathieu Fehr, Olivier Buffet, Vincent Thomas, Jilles Dibangoye

Many state-of-the-art algorithms for solving Partially Observable Markov Decision Processes (POMDPs) rely on turning the problem into a “fully observable” problem—a belief MDP—and exploiting the piece-wise linearity and …

Online Learning for Unknown Partially Observable MDPs

2021-02-25 · Mehdi Jafarnia-Jahromi, Rahul Jain, Ashutosh Nayyar

Solving Partially Observable Markov Decision Processes (POMDPs) is hard. Learning optimal controllers for POMDPs when the model is unknown is harder. Online learning of optimal controllers for unknown POMDPs, which requi…

Monte-Carlo Planning in Large POMDPs

2010-12-01 · NeurIPS 2010 12 · David Silver, Joel Veness

This paper introduces a Monte-Carlo algorithm for online planning in large POMDPs. The algorithm combines a Monte-Carlo update of the agent's belief state with a Monte-Carlo tree search from the current belief state. The…