Active Visual Localization for Multi-Agent Collaboration: A Data-Driven Approach
Rather than having each newly deployed robot create its own map of its surroundings, the growing availability of SLAM-enabled devices provides the option of simply localizing in a map of another robot or device. In cases such as multi-robot or human-robot collaboration, localizing all agents in the same map is even necessary. However, localizing e.g. a ground robot in the map of a drone or head-mounted MR headset presents unique challenges due to viewpoint changes. This work investigates how active visual localization can be used to overcome such challenges of viewpoint changes. Specifically, we focus on the problem of selecting the optimal viewpoint at a given location. We compare existing approaches in the literature with additional proposed baselines and propose a novel data-driven approach. The result demonstrates the superior performance of the data-driven approach when compared to existing methods, both in controlled simulation experiments and real-world deployment.
Code (0)
등록된 구현이 없습니다.
Tasks
Visual LocalizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Active collaboration in relative observation for Multi-agent visual SLAM based on Deep Q Network
This paper proposes a unique active relative localization mechanism for multi-agent Simultaneous Localization and Mapping(SLAM),in which a agent to be observed are considered as a task, which is performed by others assis…
Deep Reinforcement LearningReinforcement LearningSimultaneous Localization and MappingGraphGeo: Multi-Agent Debate Framework for Visual Geo-localization with Heterogeneous Graph Neural Networks
Visual geo-localization requires extensive geographic knowledge and sophisticated reasoning to determine image locations without GPS metadata. Traditional retrieval methods are constrained by database coverage and qualit…
ProACT: Towards Breakdown-Aware Proactive Agent in Multi-User Collaboration
Conversational agents are increasingly embedded in human collaborative work, yet they remain fundamentally passive and reactive: they respond to explicit user requests rather than proactively recognizing moments when a t…
Decision MakingIncentivized Collaboration in Active Learning
In collaborative active learning, where multiple agents try to learn labels from a common hypothesis, we introduce an innovative framework for incentivized collaboration. Here, rational agents aim to obtain labels for th…
Active LearningDense Audio-Visual Event Localization under Cross-Modal Consistency and Multi-Temporal Granularity Collaboration
In the field of audio-visual learning, most research tasks focus exclusively on short videos. This paper focuses on the more practical Dense Audio-Visual Event Localization (DAVEL) task, advancing audio-visual scene unde…
audio-visual event localizationaudio-visual learningScene Understanding