Qualitative Possibilistic Mixed-Observable MDPs

2013-09-26 · Nicolas Drougard, Florent Teichteil-Konigsbuch, Jean-Loup Farges, Didier Dubois

Possibilistic and qualitative POMDPs (pi-POMDPs) are counterparts of POMDPs used to model situations where the agent's initial belief or observation probabilities are imprecise due to lack of past experiences or insufficient data collection. However, like probabilistic POMDPs, optimally solving pi-POMDPs is intractable: the finite belief state space exponentially grows with the number of system's states. In this paper, a possibilistic version of Mixed-Observable MDPs is presented to get around this issue: the complexity of solving pi-POMDPs, some state variables of which are fully observable, can be then dramatically reduced. A value iteration algorithm for this new formulation under infinite horizon is next proposed and the optimality of the returned policy (for a specified criterion) is shown assuming the existence of a "stay" action in some goal states. Experimental work finally shows that this possibilistic model outperforms probabilistic POMDPs commonly used in robotics, for a target recognition problem where the agent's observations are imprecise.

📄 PDF Abstract BibTeX arXiv:1309.6826

Code (0)

등록된 구현이 없습니다.

The effect of prudence on the optimal allocation in possibilistic and mixed models

2018-05-15

In this paper two portfolio choice models are studied: a purely possibilistic model, in which the return of a risky asset is a fuzzy number, and a mixed model in which a probabilistic background risk is added. For the tw…

The Value Function Semi-Algebraic Set in Partially Observable Markov Decision Processes

2026-06-02 · Ryan A. Anderson, Guido Montufar arxiv

We study the geometry of feasible value functions in infinite-horizon partially observable Markov decision processes (POMDPs) under memoryless stochastic policies. Our main contribution is a characterization of the feasi…

Provably Efficient Reinforcement Learning in Partially Observable Dynamical Systems

2022-06-24 · Masatoshi Uehara, Ayush Sekhari, Jason D. Lee, Nathan Kallus 외

We study Reinforcement Learning for partially observable dynamical systems using function approximation. We propose a new \textit{Partially Observable Bilinear Actor-Critic framework}, that is general enough to include m…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning to Act in Decentralized Partially Observable MDPs

2018-07-01 · ICML 2018 7 · Jilles Dibangoye, Olivier Buffet

We address a long-standing open problem of reinforcement learning in decentralized partially observable Markov decision processes. Previous attempts focussed on different forms of generalized policy iteration, which…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Structural Equivalence and Learning Dynamics in Delayed MARL

2026-05-05 · Jules Sintes, Ana Bušić, Jiamin Zhu arxiv

We formally establish the equivalence between Observation Delay (OD) and Action Delay (AD) in cooperative partially observable multi-agent systems using observation-action histories. We show that both systems generate id…