paper-with-me

Papers

Hierarchical Policy Blending as Inference for Reactive Robot Control

2022-10-14 · Kay Hansel, Julen Urain, Jan Peters, Georgia Chalvatzaki

Motion generation in cluttered, dense, and dynamic environments is a central topic in robotics, rendered as a multi-objective decision-making problem. Current approaches trade-off between safety and performance. On the one hand, reactive policies guarantee fast response to environmental changes at the risk of suboptimal behavior. On the other hand, planning-based motion generation provides feasible trajectories, but the high computational cost may limit the control frequency and thus safety. To combine the benefits of reactive policies and planning, we propose a hierarchical motion generation method. Moreover, we adopt probabilistic inference methods to formalize the hierarchical model and stochastic optimization. We realize this approach as a weighted product of stochastic, reactive expert policies, where planning is used to adaptively compute the optimal weights over the task horizon. This stochastic optimization avoids local optima and proposes feasible reactive plans that find paths in cluttered and dense environments. Our extensive experimental study in planar navigation and 6DoF manipulation shows that our proposed hierarchical motion generation method outperforms both myopic reactive controllers and online re-planning methods.

📄 PDF Abstract BibTeX arXiv:2210.07890

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingMotion GenerationStochastic Optimization

Similar Papers 제목 키워드 기반

Hierarchical Policy Blending As Optimal Transport

2022-12-04 · An T. Le, Kay Hansel, Jan Peters, Georgia Chalvatzaki

We present hierarchical policy blending as optimal transport (HiPBOT). HiPBOT hierarchically adjusts the weights of low-level reactive expert policies of different agents by adding a look-ahead planning layer on the para…

FDA Flocking: Future Direction-Aware Flocking via Velocity Prediction

2026-02-03 · Hossein B. Jond, Martin Saska arxiv

Understanding self-organization in natural collectives such as bird flocks inspires swarm robotics, yet most flocking models remain reactive, overlooking anticipatory cues that enhance coordination. Motivated by avian po…

Hierarchical Reinforcement Learning of Locomotion Policies in Response to Approaching Objects: A Preliminary Study

2022-03-20 · Shangqun Yu, Sreehari Rammohan, Kaiyu Zheng, George Konidaris

Animals such as rabbits and birds can instantly generate locomotion behavior in reaction to a dynamic, approaching object, such as a person or a rock, despite having possibly never seen the object before and having limit…

Deep Reinforcement LearningHierarchical Reinforcement LearningMuJoCoObject+3

Deep Reactive Policy: Learning Reactive Manipulator Motion Planning for Dynamic Environments

2025-09-08 · Jiahui Yang, Jason Jingzhou Liu, Yulong Li, Youssef Khaky 외 arxiv

Generating collision-free motion in dynamic, partially observable environments is a fundamental challenge for robotic manipulators. Classical motion planners can compute globally optimal trajectories but require full env…

Motion Planning

HiPolicy: Hierarchical Multi-Frequency Action Chunking for Policy Learning

2026-04-07 · Jiyao Zhang, Zimu Han, Junhan Wang, Xionghao Wu 외 arxiv

Robotic imitation learning faces a fundamental trade-off between modeling long-horizon dependencies and enabling fine-grained closed-loop control. Existing fixed-frequency action chunking approaches struggle to achieve b…