paper-with-me

홈 › Papers

POMDP Planning for Object Search in Partially Unknown Environment

2023-09-21 · NeurIPS 2023 11

Efficiently searching for target objects in complex environments that contain various types of furniture, such as shelves, tables, and beds, is crucial for mobile robots, but it poses significant challenges due to various factors such as localization errors, limited field of view, and visual occlusion. To address this problem, we propose a Partially Observable Markov Decision Process (POMDP) formulation with a growing state space for object search in a 3D region. We solve this POMDP by carefully designing a perception module and developing a planning algorithm, called Growing Partially Observable Monte-Carlo Planning (GPOMCP), based on online Monte-Carlo tree search and belief tree reuse with a novel upper confidence bound. We have demonstrated that belief tree reuse is reasonable and achieves good performance when the belief differences are limited. Additionally, we introduce a guessed target object with an updating grid world to guide the search in the information-less and reward-less cases, like the absence of any detected objects. We tested our approach using Gazebo simulations on four scenarios of target finding in a realistic indoor living environment with the Fetch robot simulator. Compared to the baseline approaches, which are based on POMCP, our results indicate that our approach enables the robot to find the target object with a higher success rate faster while using the same computational requirements.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Monte-Carlo Tree Search Monte-Carlo Tree Search is a planning algorithm that accumulates value estimates obtained from Monte Carlo simulations in order to successively direct simulations towards more…

Similar Papers 제목 키워드 기반

Interleaved POMDP Planning for Multi-Object Search in Unknown Multi-Room Household Environments

2026-07-11 · Ruochu Yang, Ziyi Xia, Huibo Zhang, Yatong Han 외 arxiv

Multi-object search in unknown household environments requires planning under extensive uncertainty - from unknown object locations to cluttered spaces with unobserved obstacles. POMDPs offer a principled framework for s…

Constrained Hierarchical Monte Carlo Belief-State Planning

2023-10-30 · Arec Jamgochian, Hugo Buurmeijer, Kyle H. Wray, Anthony Corso 외

Optimal plans in Constrained Partially Observable Markov Decision Processes (CPOMDPs) maximize reward objectives while satisfying hard cost constraints, generalizing safe planning under state and transition uncertainty. …

Hierarchical Object-Oriented POMDP Planning for Object Rearrangement

2024-12-02 · Rajesh Mangannavar, Alan Fern, Prasad Tadepalli

We present an online planning framework for solving multi-object rearrangement problems in partially observable, multi-room environments. Current object rearrangement solutions, primarily based on Reinforcement Learning …

ObjectObject Rearrangement

LEGS-POMDP: Language and Gesture-Guided Object Search in Partially Observable Environments

2026-03-05 · Ivy Xiao He, Stefanie Tellex, Jason Xinyu Liu arxiv

To assist humans in open-world environments, robots must interpret ambiguous instructions to locate desired objects. Foundation model-based approaches excel at multimodal grounding, but they lack a principled mechanism f…

Tru-POMDP: Task Planning Under Uncertainty via Tree of Hypotheses and Open-Ended POMDPs

2025-06-03 · Wenjing Tang, Xinyu He, Yongxi Huang, Yunxiao Xiao 외

Task planning under uncertainty is essential for home-service robots operating in the real world. Tasks involve ambiguous human instructions, hidden or unknown object locations, and open-vocabulary object types, leading …

ObjectObject RearrangementTask Planning