paper-with-me

Papers

Knowledge-Based Hierarchical POMDPs for Task Planning

2021-03-19 · Sergio A. Serrano, Elizabeth Santiago, Jose Martinez-Carranza, Eduardo Morales, L. Enrique Sucar

The main goal in task planning is to build a sequence of actions that takes an agent from an initial state to a goal state. In robotics, this is particularly difficult because actions usually have several possible results, and sensors are prone to produce measurements with error. Partially observable Markov decision processes (POMDPs) are commonly employed, thanks to their capacity to model the uncertainty of actions that modify and monitor the state of a system. However, since solving a POMDP is computationally expensive, their usage becomes prohibitive for most robotic applications. In this paper, we propose a task planning architecture for service robotics. In the context of service robot design, we present a scheme to encode knowledge about the robot and its environment, that promotes the modularity and reuse of information. Also, we introduce a new recursive definition of a POMDP that enables our architecture to autonomously build a hierarchy of POMDPs, so that it can be used to generate and execute plans that solve the task at hand. Experimental results show that, in comparison to baseline methods, by following a recursive hierarchical approach the architecture is able to significantly reduce the planning time, while maintaining (or even improving) the robustness under several scenarios that vary in uncertainty and size.

📄 PDF Abstract BibTeX arXiv:2103.10642

Code (1)

saSerrano/hpomdp 공식 구현

Tasks

Task Planning

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Similar Papers 제목 키워드 기반

Constrained Hierarchical Monte Carlo Belief-State Planning

2023-10-30 · Arec Jamgochian, Hugo Buurmeijer, Kyle H. Wray, Anthony Corso 외

Optimal plans in Constrained Partially Observable Markov Decision Processes (CPOMDPs) maximize reward objectives while satisfying hard cost constraints, generalizing safe planning under state and transition uncertainty. …

Monte-Carlo Planning in Large POMDPs

2010-12-01 · NeurIPS 2010 12 · David Silver, Joel Veness

This paper introduces a Monte-Carlo algorithm for online planning in large POMDPs. The algorithm combines a Monte-Carlo update of the agent's belief state with a Monte-Carlo tree search from the current belief state. The…

PODDP: Partially Observable Differential Dynamic Programming for Latent Belief Space Planning

2019-12-14 · Dicong Qiu, Yibiao Zhao, Chris L. Baker

Autonomous agents are limited in their ability to observe the world state. Partially observable Markov decision processes (POMDPs) formally model the problem of planning under world state uncertainty, but POMDPs with con…

BoT-Drive: Hierarchical Behavior and Trajectory Planning for Autonomous Driving using POMDPs

2024-09-27 · Xuanjin Jin, Chendong Zeng, Shengfa Zhu, Chunxiao Liu 외

Uncertainties in dynamic road environments pose significant challenges for behavior and trajectory planning in autonomous driving. This paper introduces BoT-Drive, a planning algorithm that addresses uncertainties at bot…

Autonomous DrivingDecision MakingTrajectory Planning

Learning Others' Intentional Models in Multi-Agent Settings Using Interactive POMDPs

2018-12-01 · NeurIPS 2018 12 · Yanlin Han, Piotr Gmytrasiewicz

Interactive partially observable Markov decision processes (I-POMDPs) provide a principled framework for planning and acting in a partially observable, stochastic and multi-agent environment. It extends POMDPs to multi-a…

Bayesian Inference