Impedance Primitive-augmented Hierarchical Reinforcement Learning for Sequential Tasks

2025-08-27 · Amin Berjaoui Tahmaz, Ravi Prakash, Jens Kober arxiv

This paper presents an Impedance Primitive-augmented hierarchical reinforcement learning framework for efficient robotic manipulation in sequential contact tasks. We leverage this hierarchical structure to sequentially execute behavior primitives with variable stiffness control capabilities for contact tasks. Our proposed approach relies on three key components: an action space enabling variable stiffness control, an adaptive stiffness controller for dynamic stiffness adjustments during primitive execution, and affordance coupling for efficient exploration while encouraging compliance. Through comprehensive training and evaluation, our framework learns efficient stiffness control capabilities and demonstrates improvements in learning efficiency, compositionality in primitive selection, and success rates compared to the state-of-the-art. The training environments include block lifting, door opening, object pushing, and surface cleaning. Real world evaluations further confirm the framework's sim2real capability. This work lays the foundation for more adaptive and versatile robotic manipulation systems, with potential applications in more complex contact-based tasks.

📄 PDF Abstract BibTeX arXiv:2508.19607

Code (0)

등록된 구현이 없습니다.

Tasks

Hierarchical Reinforcement Learning

Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks

2021-10-07 · Soroush Nasiriany, Huihan Liu, Yuke Zhu

Realistic manipulation tasks require a robot to interact with an environment with a prolonged sequence of motor actions. While deep reinforcement learning methods have recently emerged as a promising paradigm for automat…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Safe and Optimal Variable Impedance Control via Certified Reinforcement Learning

2025-11-20 · Shreyas Kumar, Ravi Prakash arxiv

Reinforcement learning (RL) offers a powerful approach for robots to learn complex, collaborative skills by combining Dynamic Movement Primitives (DMPs) for motion and Variable Impedance Control (VIC) for compliant inter…

Reinforcement Learning

Reinforcement Learning with Competitive Ensembles of Information-Constrained Primitives

2019-06-25 · ICLR 2020 1 · Anirudh Goyal, Shagun Sodhani, Jonathan Binas, Xue Bin Peng 외

Reinforcement learning agents that operate in diverse and complex environments can benefit from the structured decomposition of their behavior. Often, this is addressed in the context of hierarchical reinforcement learni…

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

PIPER: Primitive-Informed Preference-based Hierarchical Reinforcement Learning via Hindsight Relabeling

2024-04-20 · Utsav Singh, Wesley A. Suttle, Brian M. Sadler, Vinay P. Namboodiri 외

In this work, we introduce PIPER: Primitive-Informed Preference-based Hierarchical reinforcement learning via Hindsight Relabeling, a novel approach that leverages preference-based learning to learn a reward model, and s…

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning

Learning to Plan & Schedule with Reinforcement-Learned Bimanual Robot Skills

2025-10-29 · Weikang Wan, Fabio Ramos, Xuning Yang, Caelan Garrett arxiv

Long-horizon contact-rich bimanual manipulation presents a significant challenge, requiring complex coordination involving a mixture of parallel execution and sequential collaboration between arms. In this paper, we intr…