Robot Policy Evaluation for Sim-to-Real Transfer: A Benchmarking Perspective

2025-08-14 · Xuning Yang, Clemens Eppner, Jonathan Tremblay, Dieter Fox, Stan Birchfield, Fabio Ramos arxiv

Current vision-based robotics simulation benchmarks have significantly advanced robotic manipulation research. However, robotics is fundamentally a real-world problem, and evaluation for real-world applications has lagged behind in evaluating generalist policies. In this paper, we discuss challenges and desiderata in designing benchmarks for generalist robotic manipulation policies for the goal of sim-to-real policy transfer. We propose 1) utilizing high visual-fidelity simulation for improved sim-to-real transfer, 2) evaluating policies by systematically increasing task complexity and scenario perturbation to assess robustness, and 3) quantifying performance alignment between real-world performance and its simulation counterparts.

📄 PDF Abstract BibTeX arXiv:2508.11117

Code (0)

등록된 구현이 없습니다.

PolaRiS: Scalable Real-to-Sim Evaluations for Generalist Robot Policies

2025-12-18 · Arhan Jain, Mingtong Zhang, Kanav Arora, William Chen 외 arxiv

A significant challenge for robot learning research is our ability to accurately measure and compare the performance of robot policies. Benchmarking in robotics is historically challenging due to the stochasticity, repro…

Solving the Real Robot Challenge using Deep Reinforcement Learning

2021-09-30 · Robert McCarthy, Francisco Roldan Sanchez, Qiang Wang, David Cordova Bulens 외

This paper details our winning submission to Phase 1 of the 2021 Real Robot Challenge; a challenge in which a three-fingered robot must carry a cube along specified goal trajectories. To solve Phase 1, we use a pure rein…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

NavBench: A Unified Robotics Benchmark for Reinforcement Learning-Based Autonomous Navigation

2025-05-20 · Matteo El-Hariry, Antoine Richard, Ricard M. Castan, Luis F. W. Batista 외

Autonomous robots must navigate and operate in diverse environments, from terrestrial and aquatic settings to aerial and space domains. While Reinforcement Learning (RL) has shown promise in training policies for specifi…

Autonomous Navigation Benchmarking Navigate Reinforcement Learning (RL)

Learning Transferable Dynamics Priors from Action to World Modeling

2026-06-28 · Ze Huang, Jiahui Zhang, Hairuo Liu, Chenxi Zhang 외 arxiv

We study action-conditioned world modeling as a scalable way to learn transferable dynamics priors for robot learning. By pretraining a model to predict how actions drive visual scene evolution, the resulting world model…

Robot Manipulation Video Generation

GSWorld: Closed-Loop Photo-Realistic Simulation Suite for Robotic Manipulation

2025-10-23 · Guangqi Jiang, Haoran Chang, Ri-Zhao Qiu, Yutong Liang 외 arxiv

This paper presents GSWorld, a robust, photo-realistic simulator for robotics manipulation that combines 3D Gaussian Splatting with physics engines. Our framework advocates "closing the loop" of developing manipulation p…

Reinforcement Learning Robot Manipulation