paper-with-me

홈 › Papers

HyperSim: A Holistic Sim-To-Real Framework For Robust Robotic Manipulation

2026-05-26 · Junyi Dong, Haotian Luo, Ziwei Xu, Shengwei Bian, Heng Zhang, Sitong Mao, Jingyi Guo, Yang Xu, Wenhao Chen, Qiuyu Feng, Yao Mu, Ping Luo, Shunbo Zhou, Xiaodong Wu arxiv

Scaling data volume and diversity is critical for generalizing embodied intelligence. While synthetic data generation offers a scalable alternative to expensive physical data acquisition, transferring robotic manipulation policies from simulation to the real world (sim-to-real) remains a formidable challenge due to the domain gap. This paper presents HyperSim, a holistic framework spanning from synthetic data generation to policy training and seamless real-world deployment. To systematically bridge the sim-to-real gap, HyperSim is realized through three core pillars: high-fidelity environment synthesis, adversarial trajectory generation, and sim-and-real co-training. Collectively, these modules address domain discrepancies by enhancing visual fidelity, expanding data coverage, and enforcing domain-invariant representations. We rigorously validate HyperSim through a large-scale empirical study involving 400 real-world task executions across two representative manipulation models. Assessed across three fine-grained metrics, our complete pipeline achieves remarkable sim-to-real success rates of 80% and 95% with ACT and π_{0}, respectively. Furthermore, policies trained on our adversarial trajectories exhibit significantly enhanced robustness against dynamic uncertainties, achieving a 35% higher completion rate under physical perturbations.

📄 PDF Abstract BibTeX arXiv:2605.26638

Code (0)

등록된 구현이 없습니다.

Tasks

Synthetic Data Generation

Similar Papers 제목 키워드 기반

Learning Geometrically-Grounded 3D Visual Representations for View-Generalizable Robotic Manipulation

2026-01-30 · Di Zhang, Weicheng Duan, Dasen Gu, Hongye Lu 외 arxiv

Real-world robotic manipulation demands visuomotor policies capable of robust spatial scene understanding and strong generalization across diverse camera viewpoints. While recent advances in 3D-aware visual representatio…

Scene Understanding

Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding

2020-11-04 · ICCV 2021 10 · Mike Roberts, Jason Ramapuram, Anurag Ranjan, Atulit Kumar 외

For many fundamental scene understanding tasks, it is difficult or impossible to obtain per-pixel ground truth labels from real images. We address this challenge by introducing Hypersim, a photorealistic synthetic datase…

Multi-Task LearningScene UnderstandingSemantic Segmentation

GR-Dexter Technical Report

2025-12-30 · Ruoshi Wen, Guangzeng Chen, Zhongren Cui, Min Du 외 arxiv

Vision-language-action (VLA) models have enabled language-conditioned, long-horizon robot manipulation, but most existing systems are limited to grippers. Scaling VLA policies to bimanual robots with high degree-of-freed…

Robot Manipulation

TWIST2: Scalable, Portable, and Holistic Humanoid Data Collection System

2025-11-04 · Yanjie Ze, Siheng Zhao, Weizhuo Wang, Angjoo Kanazawa 외 arxiv

Large-scale data has driven breakthroughs in robotics, from language models to vision-language-action models in bimanual manipulation. However, humanoid robotics lacks equally effective data collection frameworks. Existi…

Learning 3D Object Shape and Layout without 3D Supervision

2022-06-14 · CVPR 2022 1 · Georgia Gkioxari, Nikhila Ravi, Justin Johnson

A 3D scene consists of a set of objects, each with a shape and a layout giving their position in space. Understanding 3D scenes from 2D images is an important goal, with applications in robotics and graphics. While there…

Object