Self-Motivated Communication Agent for Real-World Vision-Dialog Navigation

2021-01-01 · ICCV 2021 10 · Yi Zhu, Yue Weng, Fengda Zhu, Xiaodan Liang, Qixiang Ye, Yutong Lu, Jianbin Jiao

Vision-Dialog Navigation (VDN) requires an agent to ask questions and navigate following the human responses to find target objects. Conventional approaches are only allowed to ask questions at predefined locations, which are built upon expensive dialogue annotations, and inconvenience the real-word human-robot communication and cooperation. In this paper, we propose a Self-Motivated Communication Agent (SCoA) that learns whether and what to communicate with human adaptively to acquire instructive information for realizing dialogue annotation-free navigation and enhancing the transferability in real-world unseen environment. Specifically, we introduce a whether-to-ask (WeTA) policy, together with uncertainty of which action to choose, to indicate whether the agent should ask a question. Then, a what-to-ask (WaTA) policy is proposed, in which, along with the oracle's answers, the agent learns to score question candidates so as to pick up the most informative one for navigation, and meanwhile mimic oracle's answering. Thus, the agent can navigate in a self-Q&A manner even in real-world environment where the human assistance is often unavailable. Through joint optimization of communication and navigation in a unified imitation learning and reinforcement learning framework, SCoA asks a question if necessary and obtains a hint for guiding the agent to move towards the target with less communication cost. Experiments on seen and unseen environments demonstrate that SCoA shows not only superior performance over existing baselines without dialog annotations, but also competing results compared with rich dialog annotations based counterparts.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation LearningNavigate

SSoC: Learning Spontaneous and Self-Organizing Communication for Multi-Agent Collaboration

2019-05-01 · ICLR 2019 5 · Xiangyu Kong, Jing Li, Bo Xin, Yizhou Wang

Multi-agent collaboration is required by numerous real-world problems. Although distributed setting is usually adopted by practical systems, local range communication and information aggregation still matter in fulfillin…

Multi-agent Reinforcement Learning Reinforcement Learning

Efficient Communication via Self-supervised Information Aggregation for Online and Offline Multi-agent Reinforcement Learning

2023-02-19 · Cong Guan, Feng Chen, Lei Yuan, Zongzhang Zhang 외

Utilizing messages from teammates can improve coordination in cooperative Multi-agent Reinforcement Learning (MARL). Previous works typically combine raw messages of teammates with local information as inputs for policy.…

Decision Making Multi-agent Reinforcement Learning Representation Learning

An Unified Intelligence-Communication Model for Multi-Agent System Part-I: Overview

2018-11-25 · Bo Zhang, Bin Chen, Jinyu Yang, Wenjing Yang 외

Motivated by Shannon's model and recent rehabilitation of self-supervised artificial intelligence having a "World Model", this paper propose an unified intelligence-communication (UIC) model for describing a single agent…

PAC Guarantees for Cooperative Multi-Agent Reinforcement Learning with Restricted Communication

2019-05-23 · Or Raveh, Ron Meir

We develop model free PAC performance guarantees for multiple concurrent MDPs, extending recent works where a single learner interacts with multiple non-interacting agents in a noise free environment. Our framework allow…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Are Large Language Models Sensitive to the Motives Behind Communication?

2025-10-22 · Addison J. Wu, Ryan Liu, Kerem Oktar, Theodore R. Sumers 외 arxiv

Human communication is motivated: people speak, write, and create content with a particular communicative intent in mind. As a result, information that large language models (LLMs) and AI agents process is inherently fra…