paper-with-me

Papers

RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots

2024-06-04 · Soroush Nasiriany, Abhiram Maddukuri, Lance Zhang, Adeet Parikh, Aaron Lo, Abhishek Joshi, Ajay Mandlekar, Yuke Zhu

Recent advancements in Artificial Intelligence (AI) have largely been propelled by scaling. In Robotics, scaling is hindered by the lack of access to massive robot datasets. We advocate using realistic physical simulation as a means to scale environments, tasks, and datasets for robot learning methods. We present RoboCasa, a large-scale simulation framework for training generalist robots in everyday environments. RoboCasa features realistic and diverse scenes focusing on kitchen environments. We provide thousands of 3D assets across over 150 object categories and dozens of interactable furniture and appliances. We enrich the realism and diversity of our simulation with generative AI tools, such as object assets from text-to-3D models and environment textures from text-to-image models. We design a set of 100 tasks for systematic evaluation, including composite tasks generated by the guidance of large language models. To facilitate learning, we provide high-quality human demonstrations and integrate automated trajectory generation methods to substantially enlarge our datasets with minimal human burden. Our experiments show a clear scaling trend in using synthetically generated robot data for large-scale imitation learning and show great promise in harnessing simulation data in real-world tasks. Videos and open-source code are available at https://robocasa.ai/

📄 PDF Abstract BibTeX arXiv:2406.02523

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation LearningText to 3D

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robots

2026-03-04 · Soroush Nasiriany, Sepehr Nasiriany, Abhiram Maddukuri, Yuke Zhu arxiv

Recent advances in robot learning have accelerated progress toward generalist robots that can perform everyday tasks in human environments. Yet it remains difficult to gauge how close we are to this vision. The field lac…

Multi-Task Learning

SeeTraceAct: Visibility-Aware Latent Planning from Cross-Embodiment Demonstration Videos

2026-06-01 · Jaehyeon Son, Junhyun Kim, Kyle Kam, Jeremiah Coholich 외 arxiv

Vision-language-action models (VLAs) are promising general-purpose robot policies, but adapting them to new tasks typically requires costly task-specific teleoperation data. As an alternative, we study one-shot demo-cond…

Multi-Task Interactive Robot Fleet Learning with Visual World Models

2024-10-30 · Huihan Liu, Yu Zhang, Vaarij Betala, Evan Zhang 외

Recent advancements in large-scale multi-task robot learning offer the potential for deploying robot fleets in household and industrial settings, enabling them to perform diverse tasks across various environments. Howeve…

Video2Policy: Scaling up Manipulation Tasks in Simulation through Internet Videos

2025-02-14 · Weirui Ye, Fangchen Liu, Zheng Ding, Yang Gao 외

Simulation offers a promising approach for cheaply scaling training data for generalist policies. To scalably generate data from diverse and realistic tasks, existing algorithms either rely on large language models (LLMs…

Riemann-1.0: An Embodied World Action Model for Physical AI

2026-08-27 · Haofeng Sun, Jiangbo Pei, Fei Kang, Zexiang Liu 외 arxiv

We introduce Riemann-1.0, a fully causal autoregressive World Action Model for embodied intelligence. Riemann-1.0 jointly models multi-view visual observations, robot states, and embodiment-specific actions within a unif…

Robot Manipulation