paper-with-me

Papers

AllenAct: A Framework for Embodied AI Research

2020-08-28 · Luca Weihs, Jordi Salvador, Klemen Kotar, Unnat Jain, Kuo-Hao Zeng, Roozbeh Mottaghi, Aniruddha Kembhavi

The domain of Embodied AI, in which agents learn to complete tasks through interaction with their environment from egocentric observations, has experienced substantial growth with the advent of deep reinforcement learning and increased interest from the computer vision, NLP, and robotics communities. This growth has been facilitated by the creation of a large number of simulated environments (such as AI2-THOR, Habitat and CARLA), tasks (like point navigation, instruction following, and embodied question answering), and associated leaderboards. While this diversity has been beneficial and organic, it has also fragmented the community: a huge amount of effort is required to do something as simple as taking a model trained in one environment and testing it in another. This discourages good science. We introduce AllenAct, a modular and flexible learning framework designed with a focus on the unique requirements of Embodied AI research. AllenAct provides first-class support for a growing collection of embodied environments, tasks and algorithms, provides reproductions of state-of-the-art models and includes extensive documentation, tutorials, start-up code, and pre-trained models. We hope that our framework makes Embodied AI more accessible and encourages new researchers to join this exciting area. The framework can be accessed at: https://allenact.org/

📄 PDF Abstract BibTeX arXiv:2008.12760

Code (1)

allenai/allenact pytorch

Tasks

Deep Reinforcement LearningEmbodied Question AnsweringInstruction FollowingQuestion Answering

Similar Papers 제목 키워드 기반

The Semantic Lifecycle in Embodied AI: Acquisition, Representation and Storage via Foundation Models

2026-01-12 · Shuai Chen, Hao Chen, Yuanchen Bei, Tianyang Zhao 외 arxiv

Semantic information in embodied AI is inherently multi-source and multi-stage, making it challenging to fully leverage for achieving stable perception-to-action loops in real-world environments. Early studies have combi…

Domain Generalization

Extending Embodied Question Answering from Perception to Decision

2026-05-25 · Xicheng Gong, Qiwei Li, Peiran Xu, Yadong Mu arxiv

Embodied Question Answering (EQA) connects perception, reasoning, and interaction within embodied environments. However, existing datasets and benchmarks remain fragmented, each focusing on a limited subset of reasoning …

Question Answering

Survey of Vision-Language-Action Models for Embodied Manipulation

2025-08-21 · Haoran Li, Yuhui Chen, Wenbo Cui, Weiheng Liu 외 arxiv

Embodied intelligence systems, which enhance agent capabilities through continuous environment interactions, have garnered significant attention from both academia and industry. Vision-Language-Action models, inspired by…

A Survey of Embodied AI: From Simulators to Research Tasks

2021-03-08 · Jiafei Duan, Samson Yu, Hui Li Tan, Hongyuan Zhu 외

There has been an emerging paradigm shift from the era of "internet AI" to "embodied AI", where AI algorithms and agents no longer learn from datasets of images, videos or text curated primarily from the internet. Instea…

Embodied Question AnsweringQuestion AnsweringSurveyVisual Navigation

Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models

2026-06-09 · Yifu Yuan, Yaoting Huang, Xianze Yao, Yutong Li 외 arxiv

We introduce Embodied-R1.5, a unified Embodied Foundation Model (EFM) that integrates comprehensive embodied reasoning capabilities, spanning embodied cognition, task planning, correction, and pointing, within a single a…

Instruction Following