paper-with-me

Papers

ASC me to Do Anything: Multi-task Training for Embodied AI

2022-02-14 · Jiasen Lu, Jordi Salvador, Roozbeh Mottaghi, Aniruddha Kembhavi

Embodied AI has seen steady progress across a diverse set of independent tasks. While these varied tasks have different end goals, the basic skills required to complete them successfully overlap significantly. In this paper, our goal is to leverage these shared skills to learn to perform multiple tasks jointly. We propose Atomic Skill Completion (ASC), an approach for multi-task training for Embodied AI, where a set of atomic skills shared across multiple tasks are composed together to perform the tasks. The key to the success of this approach is a pre-training scheme that decouples learning of the skills from the high-level tasks making joint training effective. We use ASC to train agents within the AI2-THOR environment to perform four interactive tasks jointly and find it to be remarkably effective. In a multi-task setting, ASC improves success rates by a factor of 2x on Seen scenes and 4x on Unseen scenes compared to no pre-training. Importantly, ASC enables us to train a multi-task agent that has a 52% higher Success Rate than training 4 independent single task agents. Finally, our hierarchical agents are more interpretable than traditional black-box architectures.

📄 PDF Abstract BibTeX arXiv:2202.06987

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

TeachAnything: A Multimodal Crowdsourcing Platform for Training Embodied AI Agents in Symmetrical Reality

2026-05-14 · Zidong Liu, Rongkai Liu, Yue Li, Zhenliang Zhang arxiv

Symmetrical Reality (SR) is emerging as a future trend for human-agent coexistence, placing higher demands on agents to acquire human-like intelligence. It calls for richer and more diverse human guidance. We introduce a…

URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Model

2025-11-02 · Zhe Li, Xiang Bai, Jieyu Zhang, Zhuangzhe Wu 외 arxiv

Constructing accurate digital twins of articulated objects is essential for robotic simulation training and embodied AI world model building, yet historically requires painstaking manual modeling or multi-stage pipelines…

Parameter Prediction

Mirage2Matter: A Physically Grounded Gaussian World Model from Video

2026-01-24 · Zhengqing Gao, Ziwen Li, Xin Wang, Jiaxin Huang 외 arxiv

The scalability of embodied intelligence is fundamentally constrained by the scarcity of real-world interaction data. While simulation platforms provide a promising alternative, existing approaches often suffer from a su…

PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Image

2025-11-17 · Ziang Cao, Fangzhou Hong, Zhaoxi Chen, Liang Pan 외 arxiv

3D modeling is shifting from static visual representations toward physical, articulated assets that can be directly used in simulation and interaction. However, most existing 3D generation methods overlook key physical a…

3D Generation

Empowering Embodied Visual Tracking with Visual Foundation Models and Offline RL

2024-04-15 · Fangwei Zhong, Kui Wu, Hai Ci, Churan Wang 외

Embodied visual tracking is to follow a target object in dynamic 3D environments using an agent's egocentric vision. This is a vital and challenging skill for embodied agents. However, existing methods suffer from ineffi…

GPUOffline RLQ-LearningSemantic Segmentation+1