V-IRL: Grounding Virtual Intelligence in Real Life
There is a sensory gulf between the Earth that humans inhabit and the digital realms in which modern AI agents are created. To develop AI agents that can sense, think, and act as flexibly as humans in real-world settings, it is imperative to bridge the realism gap between the digital and physical worlds. How can we embody agents in an environment as rich and diverse as the one we inhabit, without the constraints imposed by real hardware and control? Towards this end, we introduce V-IRL: a platform that enables agents to scalably interact with the real world in a virtual yet realistic environment. Our platform serves as a playground for developing agents that can accomplish various practical tasks and as a vast testbed for measuring progress in capabilities spanning perception, decision-making, and interaction with real-world data across the entire globe.
Code (1)
Tasks
Decision MakingSimilar Papers 제목 키워드 기반
Emotional Responses in Artificial Agent-Based Systems: Reflexivity and Adaptation in Artificial Life
The current work addresses a virtual environment with self-replicating agents whose decisions are based on a form of "somatic computation" (soma - body) in which basic emotional responses, taken in parallelism to actual …
Artificial LifeThe DigitalTwin from an Artificial Intelligence Perspective
Services for Cyber-Physical Systems based on Artificial Intelligence and Machine Learning require a virtual representation of the physical. To reduce modeling efforts and to synchronize results, for each system, a common…
BIG-bench Machine LearningSynthesizing Event-centric Knowledge Graphs of Daily Activities Using Virtual Space
Artificial intelligence (AI) is expected to be embodied in software agents, robots, and cyber-physical systems that can understand the various contextual information of daily life in the home environment to support human…
Decision MakingEmbodied Question AnsweringKnowledge GraphsQuestion AnsweringGrounding spoken interaction with real-time gaze in dynamic virtual environments
How to Build the Virtual Cell with Artificial Intelligence: Priorities and Opportunities
The cell is arguably the most fundamental unit of life and is central to understanding biology. Accurate modeling of cells is important for this understanding as well as for determining the root causes of disease. Recent…