paper-with-me

홈 › Papers

Reinforcement learning in linear embedding space unlocks generalizable control across soft robot configurations

2026-06-06 · Xinglong Zhang, Cong Li, Hangjie Mo, Yue Jiang, Xin Xu, Wei Jiang, Zhenshan Bing, Yihe Yang, Xiaojian Li, Yueneng Yang, Huimin Lu, Ling-li Zeng, Alois Knoll, Dewen Hu, Li Wen, Wei Pan arxiv

Soft-bodied organisms such as octopuses and elephant trunks exhibit remarkable morphological adaptability, dynamically reconfiguring body shape and stiffness, and flexibly adjusting their control strategies to enable versatile behaviors. Inspired by these biological systems, various soft robots have emerged in recent decades, featuring diverse materials, stiffnesses, and morphologies tailored to specific tasks. Despite substantial advances in the materials and structural designs of soft robots, developing a generalizable control framework capable of rapid adaptation across diverse configurations remains a long-standing challenge. Existing controllers are limited to fixed configurations, demanding laborious configuration-specific remodelling and policy redesign for new configurations. Here, we introduce a generalizable control system that enables rapid adaptation across diverse soft robot configurations via reinforcement learning in a shared linear Koopman embedding space. By encoding robot dynamics into this embedding space, our method decouples control policies from specific morphologies, allowing real-time, model-free policy adaptation across diverse configurations without retraining from scratch. We validate our system across 33 distinct robot configurations. Our system achieves a 75 times reduction in transfer samples across configurations, while sustaining robust performance under high-speed motion, heavy payloads, and multiactuator faults, and achieving real-world skills previously unattainable in soft robotics. This work establishes a unified and adaptable control paradigm for diverse soft robot configurations, bridging mechanical reconfigurability with control flexibility, and may offer broader insights for generalizable control in complex physical systems.

📄 PDF Abstract BibTeX arXiv:2606.08104

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Wasserstein Wormhole: Scalable Optimal Transport Distance with Transformers

2024-04-15 · Doron Haviv, Russell Zhang Kunes, Thomas Dougherty, Cassandra Burdziak 외

Optimal transport (OT) and the related Wasserstein metric (W) are powerful and ubiquitous tools for comparing distributions. However, computing pairwise Wasserstein distances rapidly becomes intractable as cohort size gr…

Decoder

Unlocking the Capabilities of Vision-Language Models for Generalizable and Explainable Deepfake Detection

2025-03-19 · Peipeng Yu, Jianwei Fei, Hui Gao, Xuan Feng 외

Current vision-language models (VLMs) have demonstrated remarkable capabilities in understanding multimodal data, but their potential remains underexplored for deepfake detection due to the misaligned of their knowledge …

Contrastive LearningDeepFake DetectionFace SwappingLarge Language Model

Projecting Latent RL Actions: Towards Generalizable and Scalable Graph Combinatorial Optimization

2026-05-19 · Franco Terranova, Guillermo Bernardez, Albert Cabellos-Aparicio, Nina Miolane 외 arxiv

Graph combinatorial optimization (GCO) has attracted growing interest, as many NP-hard problems naturally admit graph formulations, yet their combinatorial explosion renders exact methods computationally intractable. Rec…

Reinforcement Learning

I-Scene: 3D Instance Models are Implicit Generalizable Spatial Learners

2025-12-15 · Lu Ling, Yunhao Ge, Yichen Sheng, Aniket Bera arxiv

Generalization remains the central challenge for interactive 3D scene generation. Existing learning-based approaches ground spatial understanding in limited scene dataset, restricting generalization to new layouts. We in…

Scene UnderstandingSpatial ReasoningScene Generation

FlagVNE: A Flexible and Generalizable Reinforcement Learning Framework for Network Resource Allocation

2024-04-19 · Tianfu Wang, Qilin Fan, Chao Wang, Long Yang 외

Virtual network embedding (VNE) is an essential resource allocation task in network virtualization, aiming to map virtual network requests (VNRs) onto physical infrastructure. Reinforcement learning (RL) has recently eme…

DecoderNetwork EmbeddingReinforcement Learning (RL)Scheduling