paper-with-me

홈 › Papers

Perceptive Hierarchical-Task MPC for Sequential Mobile Manipulation in Unstructured Semi-Static Environments

2026-03-10 · Xintong Du, Jingxing Qian, Siqi Zhou, Angela P. Schoellig arxiv

As compared to typical mobile manipulation tasks, sequential mobile manipulation poses a unique challenge -- as the robot operates over extended periods, successful task completion is not solely dependent on consistent motion generation but also on the robot's awareness and adaptivity to changes in the operating environment. While existing motion planners can generate whole-body trajectories to complete sequential tasks, they typically assume that the environment remains static and rely on precomputed maps. This assumption often breaks down during long-term operations, where semi-static changes such as object removal, introduction, or shifts are common. In this work, we propose a novel perceptive hierarchical-task model predictive control (HTMPC) framework for efficient sequential mobile manipulation in unstructured, changing environments. To tackle the challenge, we leverage a Bayesian inference framework to explicitly model object-level changes and thereby maintain a temporally accurate representation of the 3D environment; this up-to-date representation is embedded in a lexicographic optimization framework to enable efficient execution of sequential tasks. We validate our perceptive HTMPC approach through both simulated and real-robot experiments. In contrast to baseline methods, our approach systematically accounts for moved and phantom obstacles, successfully completing sequential tasks with higher efficiency and reactivity, without relying on prior maps or external infrastructure.

📄 PDF Abstract BibTeX arXiv:2603.10227

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Inference

Similar Papers 제목 키워드 기반

Active-Perceptive Motion Generation for Mobile Manipulation

2023-09-30 · Snehal Jauhri, Sophie Lueth, Georgia Chalvatzaki

Mobile Manipulation (MoMa) systems incorporate the benefits of mobility and dexterity, due to the enlarged space in which they can move and interact with their environment. However, even when equipped with onboard sensor…

Motion Generation

SM2ITH: Safe Mobile Manipulation with Interactive Human Prediction via Task-Hierarchical Bilevel Model Predictive Control

2025-11-21 · Francesco D'Orazio, Sepehr Samavi, Xintong Du, Siqi Zhou 외 arxiv

Mobile manipulators are designed to perform complex sequences of navigation and manipulation tasks in human-centered environments. While recent optimization-based methods such as Hierarchical Task Model Predictive Contro…

Bilevel Optimization

Hierarchical Task Model Predictive Control for Sequential Mobile Manipulation Tasks

2026-03-10 · Xintong Du, Siqi Zhou, Angela P. Schoellig arxiv

Mobile manipulators are envisioned to serve more complex roles in people's everyday lives. With recent breakthroughs in large language models, task planners have become better at translating human verbal instructions int…

PILOT: A Perceptive Integrated Low-level Controller for Loco-manipulation over Unstructured Scenes

2026-01-24 · Xinru Cui, Linxi Feng, Yixuan Zhou, Haoqi Han 외 arxiv

Humanoid robots hold great potential for diverse interactions and daily service tasks within human-centered environments, necessitating controllers that seamlessly integrate precise locomotion with dexterous manipulation…

Reinforcement Learning

SPIRIT: Perceptive Shared Autonomy for Robust Robotic Manipulation under Deep Learning Uncertainty

2026-03-05 · Jongseok Lee, Ribin Balachandran, Harsimran Singh, Jianxiang Feng 외 arxiv

Deep learning (DL) has enabled impressive advances in robotic perception, yet its limited robustness and lack of interpretability hinder reliable deployment in safety critical applications. We propose a concept termed pe…

Point Cloud Registration