Map-based Modular Approach for Zero-shot Embodied Question Answering
Embodied Question Answering (EQA) serves as a benchmark task to evaluate the capability of robots to navigate within novel environments and identify objects in response to human queries. However, existing EQA methods often rely on simulated environments and operate with limited vocabularies. This paper presents a map-based modular approach to EQA, enabling real-world robots to explore and map unknown environments. By leveraging foundation models, our method facilitates answering a diverse range of questions using natural language. We conducted extensive experiments in both virtual and real-world settings, demonstrating the robustness of our approach in navigating and comprehending queries within unknown environments.
Code (1)
Tasks
Embodied Question AnsweringNavigateQuestion AnsweringSimilar Papers 제목 키워드 기반
Modularized Zero-shot VQA with Pre-trained Models
Large-scale pre-trained models (PTMs) show great zero-shot capabilities. In this paper, we study how to leverage them for zero-shot visual question answering (VQA). Our approach is motivated by a few observations. First,…
object-detectionObject DetectionQuestion AnsweringRelational Reasoning+2Plug-and-Play VQA: Zero-shot VQA by Conjoining Large Pretrained Models with Zero Training
Visual question answering (VQA) is a hallmark of vision and language reasoning and a challenging task under the zero-shot setting. We propose Plug-and-Play VQA (PNP-VQA), a modular framework for zero-shot VQA. In contras…
Image CaptioningNetwork InterpretationQuestion AnsweringVisual Question Answering+1Multi-LLM QA with Embodied Exploration
Large language models (LLMs) have grown in popularity due to their natural language interface and pre trained knowledge, leading to rapidly increasing success in question-answering (QA) tasks. More recently, multi-agent …
Embodied Question AnsweringFeature ImportanceQuestion AnsweringLLM as A Robotic Brain: Unifying Egocentric Memory and Control
Embodied AI focuses on the study and development of intelligent systems that possess a physical or virtual embodiment (i.e. robots) and are able to dynamically interact with their environment. Memory and control are the …
Embodied Question AnsweringLanguage ModelingLanguage ModellingQuestion Answering+1LyS at SemEval 2025 Task 8: Zero-Shot Code Generation for Tabular QA
This paper describes our participation in SemEval 2025 Task 8, focused on Tabular Question Answering. We developed a zero-shot pipeline that leverages an Large Language Model to generate functional code capable of extrac…
Question AnsweringCode Generation