paper-with-me

홈 › Papers

Measurement Simplification in ρ-POMDP with Performance Guarantees

2023-09-19 · Tom Yotam, Vadim Indelman

Decision making under uncertainty is at the heart of any autonomous system acting with imperfect information. The cost of solving the decision making problem is exponential in the action and observation spaces, thus rendering it unfeasible for many online systems. This paper introduces a novel approach to efficient decision-making, by partitioning the high-dimensional observation space. Using the partitioned observation space, we formulate analytical bounds on the expected information-theoretic reward, for general belief distributions. These bounds are then used to plan efficiently while keeping performance guarantees. We show that the bounds are adaptive, computationally efficient, and that they converge to the original solution. We extend the partitioning paradigm and present a hierarchy of partitioned spaces that allows greater efficiency in planning. We then propose a specific variant of these bounds for Gaussian beliefs and show a theoretical performance improvement of at least a factor of 4. Finally, we compare our novel method to other state of the art algorithms in active SLAM scenarios, in simulation and in real experiments. In both cases we show a significant speed-up in planning with performance guarantees.

📄 PDF Abstract BibTeX arXiv:2309.10701

Code (1)

tomyot/measurement-simplification 공식 구현

Tasks

Decision MakingDecision Making Under Uncertainty

Similar Papers 제목 키워드 기반

Open-loop POMDP Simplification and Safe Skipping of Replanning with Formal Performance Guarantees

2026-04-01 · Da Kong, Vadim Indelman arxiv

Partially Observable Markov Decision Processes (POMDPs) provide a principled mathematical framework for decision-making under uncertainty. However, the exact solution to POMDPs is computationally intractable. In this pap…

Simplification of Risk Averse POMDPs with Performance Guarantees

2024-06-05 · Yaacov Pariente, Vadim Indelman

Risk averse decision making under uncertainty in partially observable domains is a fundamental problem in AI and essential for reliable autonomous agents. In our case, the problem is modeled using partially observable Ma…

Decision MakingDecision Making Under Uncertainty

Accelerated Online Risk-Averse Policy Evaluation in POMDPs with Theoretical Guarantees and Novel CVaR Bounds

2026-02-26 · Yaacov Pariente, Vadim Indelman arxiv

Risk-averse decision-making under uncertainty in partially observable domains is a central challenge in artificial intelligence and is essential for developing reliable autonomous agents. The formal framework for such pr…

Online POMDP Planning via Simplification

2021-05-11 · Ori Sztyglic, Vadim Indelman

In this paper, we consider online planning in partially observable domains. Solving the corresponding POMDP problem is a very challenging task, particularly in an online setting. Our key contribution is a novel algorithm…

No Compromise in Solution Quality: Speeding Up Belief-dependent Continuous POMDPs via Adaptive Multilevel Simplification

2023-10-16 · Andrey Zhitnikov, Ori Sztyglic, Vadim Indelman

Continuous POMDPs with general belief-dependent rewards are notoriously difficult to solve online. In this paper, we present a complete provable theory of adaptive multilevel simplification for the setting of a given ext…