Domain Randomization for Robust, Affordable and Effective Closed-loop Control of Soft Robots

2023-03-07 · Gabriele Tiboni, Andrea Protopapa, Tatiana Tommasi, Giuseppe Averta

Soft robots are gaining popularity thanks to their intrinsic safety to contacts and adaptability. However, the potentially infinite number of Degrees of Freedom makes their modeling a daunting task, and in many cases only an approximated description is available. This challenge makes reinforcement learning (RL) based approaches inefficient when deployed on a realistic scenario, due to the large domain gap between models and the real platform. In this work, we demonstrate, for the first time, how Domain Randomization (DR) can solve this problem by enhancing RL policies for soft robots with: i) robustness w.r.t. unknown dynamics parameters; ii) reduced training times by exploiting drastically simpler dynamic models for learning; iii) better environment exploration, which can lead to exploitation of environmental constraints for optimal performance. Moreover, we introduce a novel algorithmic extension to previous adaptive domain randomization methods for the automatic inference of dynamics parameters for deformable objects. We provide an extensive evaluation in simulation on four different tasks and two soft robot designs, opening interesting perspectives for future research on Reinforcement Learning for closed-loop soft robot control.

📄 PDF Abstract BibTeX arXiv:2303.04136

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Quantifying and Visualizing Sim-to-Real Gaps: Physics-Guided Regularization for Reproducibility

2025-07-31 · Yuta Kawachi arxiv

Simulation-to-real transfer using domain randomization for robot control often relies on low-gear-ratio, backdrivable actuators, but these approaches break down when the sim-to-real gap widens. Inspired by the traditiona…

Sim-to-Real via Sim-to-Sim: Data-efficient Robotic Grasping via Randomized-to-Canonical Adaptation Networks

2018-12-18 · CVPR 2019 6 · Stephen James, Paul Wohlhart, Mrinal Kalakrishnan, Dmitry Kalashnikov 외

Real world data, especially in the domain of robotics, is notoriously costly to collect. One way to circumvent this can be to leverage the power of simulation to produce large amounts of labelled data. However, training …

Domain Adaptation Reinforcement Learning Robotic Grasping

Humanoid Hanoi: Investigating Shared Whole-Body Control for Skill-Based Box Rearrangement

2026-02-14 · Minku Kim, Kuan-Chia Chen, Aayam Shrestha, Li Fuxin 외 arxiv

We investigate a skill-based framework for humanoid box rearrangement that enables long-horizon execution by sequencing reusable skills at the task level. In our architecture, all skills execute through a shared, task-ag…

Gradient-free learning of a closed-loop wall controller for turbulent drag reduction

2026-07-14 · Giorgio Maria Cavallazzi, Miguel Pérez Cuadrado, Alfredo Pinelli arxiv

Closed-loop wall controllers learnt by multi-agent reinforcement learning are usually trained on periodic boxes far smaller than the flows they are meant to drive, and a large part of their drag reduction is lost when th…

Multi-agent Reinforcement Learning

DexSim2Real: Foundation Model-Guided Sim-to-Real Transfer for Generalizable Dexterous Manipulation

2026-05-03 · Zijian Zeng, Fei Ding, Huiming Yang, Xianwei Li 외 arxiv

Sim-to-real transfer remains a critical bottleneck for deploying dexterous manipulation policies learned in simulation to real-world robots. Existing approaches rely on manually designed domain randomization or task-spec…