paper-with-me

홈 › Papers

From Tabula Rasa to Emergent Abilities: Discovering Robot Skills via Real-World Unsupervised Quality-Diversity

2025-08-26 · Luca Grillotti, Lisa Coiffard, Oscar Pang, Maxence Faldor, Antoine Cully arxiv

Autonomous skill discovery aims to enable robots to acquire diverse behaviors without explicit supervision. Learning such behaviors directly on physical hardware remains challenging due to safety and data efficiency constraints. Existing methods, including Quality-Diversity Actor-Critic (QDAC), require manually defined skill spaces and carefully tuned heuristics, limiting real-world applicability. We propose Unsupervised Real-world Skill Acquisition (URSA), an extension of QDAC that enables robots to autonomously discover and master diverse, high-performing skills directly in the real world. We demonstrate that URSA successfully discovers diverse locomotion skills on a Unitree A1 quadruped in both simulation and the real world. Our approach supports both heuristic-driven skill discovery and fully unsupervised settings. We also show that the learned skill repertoire can be reused for downstream tasks such as real-world damage adaptation, where URSA outperforms all baselines in 5 out of 9 simulated and 3 out of 5 real-world damage scenarios. Our results establish a new framework for real-world robot learning that enables continuous skill discovery with limited human intervention, representing a significant step toward more autonomous and adaptable robotic systems. Demonstration videos are available at https://adaptive-intelligent-robotics.github.io/URSA.

📄 PDF Abstract BibTeX arXiv:2508.19172

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Beyond Tabula-Rasa: a Modular Reinforcement Learning Approach for Physically Embedded 3D Sokoban

2020-10-03 · Peter Karkus, Mehdi Mirza, Arthur Guez, Andrew Jaegle 외

Intelligent robots need to achieve abstract objectives using concrete, spatiotemporally complex sensory information and motor control. Tabula rasa deep reinforcement learning (RL) has tackled demanding tasks in terms of …

Deep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)Sokoban

Combinatory Chemistry: Towards a Simple Model of Emergent Evolution

2020-03-17 · Germán Kruszewski, Tomas Mikolov

An explanatory model for the emergence of evolvable units must display emerging structures that (1) preserve themselves in time (2) self-reproduce and (3) tolerate a certain amount of variation when reproducing. To tackl…

Artificial Life

Emergence of Self-Reproducing Metabolisms as Recursive Algorithms in an Artificial Chemistry

2021-03-15 · Germán Kruszewski, Tomas Mikolov

One of the main goals of Artificial Life is to research the conditions for the emergence of life, not necessarily as it is, but as it could be. Artificial Chemistries are one of the most important tools for this purpose …

Artificial Life

Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisation

2021-06-23 · CVPR 2022 1 · Stephen James, Kentaro Wada, Tristan Laidlow, Andrew J. Davison

We present a coarse-to-fine discretisation method that enables the use of discrete reinforcement learning approaches in place of unstable and data-inefficient actor-critic methods in continuous robotics domains. This app…

Continuous ControlQ-LearningRobot ManipulationTranslation

Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm

2017-12-05 · David Silver, Thomas Hubert, Julian Schrittwieser, Ioannis Antonoglou 외

The game of chess is the most widely-studied domain in the history of artificial intelligence. The strongest programs are based on a combination of sophisticated search techniques, domain-specific adaptations, and handcr…

Game of ChessGame of GoGame of ShogiGeneral Reinforcement Learning+3