paper-with-me

Papers

ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Control

2026-01-30 · Jean Pierre Sleiman, He Li, Alphonsus Adu-Bredu, Robin Deits, Arun Kumar, Kevin Bergamin, Mohak Bhardwaj, Scott Biddlestone, Nicola Burger, Matthew A. Estrada, Francesco Iacobelli, Twan Koolen, Alexander Lambert, Erica Lin, M. Eva Mungai, Zach Nobles, Shane Rozen-Levy, Yuyao Shi, Jiashun Wang, Jakob Welner, Fangzhou Yu, Mike Zhang, Alfred Rizzi, Jessica Hodgins, Sylvain Bertrand, Yeuhi Abe, Scott Kuindersma, Farbod Farshidian arxiv

Achieving robust, human-like whole-body control on humanoid robots for agile, contact-rich behaviors remains a central challenge, demanding heavy per-skill engineering and a brittle process of tuning controllers. We introduce ZEST (Zero-shot Embodied Skill Transfer), a streamlined motion-imitation framework that trains policies via reinforcement learning from diverse sources -- high-fidelity motion capture, noisy monocular video, and non-physics-constrained animation -- and deploys them to hardware zero-shot. ZEST generalizes across behaviors and platforms while avoiding contact labels, reference or observation windows, state estimators, and extensive reward shaping. Its training pipeline combines adaptive sampling, which focuses training on difficult motion segments, and an automatic curriculum using a model-based assistive wrench, together enabling dynamic, long-horizon maneuvers. We further provide a procedure for selecting joint-level gains from approximate analytical armature values for closed-chain actuators, along with a refined model of actuators. Trained entirely in simulation with moderate domain randomization, ZEST demonstrates remarkable generality. On Boston Dynamics' Atlas humanoid, ZEST learns dynamic, multi-contact skills (e.g., army crawl, breakdancing) from motion capture. It transfers expressive dance and scene-interaction skills, such as box-climbing, directly from videos to Atlas and the Unitree G1. Furthermore, it extends across morphologies to the Spot quadruped, enabling acrobatics, such as a continuous backflip, through animation. Together, these results demonstrate robust zero-shot deployment across heterogeneous data sources and embodiments, establishing ZEST as a scalable interface between biological movements and their robotic counterparts.

📄 PDF Abstract BibTeX arXiv:2602.00401

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

ZeST: Zero-Shot Material Transfer from a Single Image

2024-04-09 · Ta-Ying Cheng, Prafull Sharma, Andrew Markham, Niki Trigoni 외

We propose ZeST, a method for zero-shot material transfer to an object in the input image given a material exemplar image. ZeST leverages existing diffusion adapters to extract implicit material representation from the e…

Appearance TransferObject

Zero Shot Audio to Audio Emotion Transfer With Speaker Disentanglement

2024-01-09 · Soumya Dutta, Sriram Ganapathy

The problem of audio-to-audio (A2A) style transfer involves replacing the style features of the source audio with those from the target audio while preserving the content related attributes of the source audio. In this p…

DecoderDisentanglementStyle Transfer

ZEST: Attention-based Zero-Shot Learning for Unseen IoT Device Classification

2023-10-12 · Binghui Wu, Philipp Gysel, Dinil Mon Divakaran, Mohan Gurusamy

Recent research works have proposed machine learning models for classifying IoT devices connected to a network. However, there is still a practical challenge of not having all devices (and hence their traffic) available …

DecoderZero-Shot Learning

Audio-to-Audio Emotion Conversion With Pitch And Duration Style Transfer

2025-05-23 · Soumya Dutta, Avni Jain, Sriram Ganapathy

Given a pair of source and reference speech recordings, audio-to-audio (A2A) style transfer involves the generation of an output speech that mimics the style characteristics of the reference while preserving the content …

Data AugmentationEmotion RecognitionStyle Transfer

LEMONADE: A Large Multilingual Expert-Annotated Abstractive Event Dataset for the Real World

2025-06-01 · Sina J. Semnani, Pingyue Zhang, Wanyue Zhai, Haozhuo Li 외

This paper presents LEMONADE, a large-scale conflict event dataset comprising 39,786 events across 20 languages and 171 countries, with extensive coverage of region-specific entities. LEMONADE is based on a partially rea…

document understandingEntity LinkingEvent ExtractionZero-shot Event Extraction