Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learning
We present a method for combining multi-agent communication and traditional data-driven approaches to natural language learning, with an end goal of teaching agents to communicate with humans in natural language. Our starting point is a language model that has been trained on generic, not task-specific language data. We then place this model in a multi-agent self-play environment that generates task-specific rewards used to adapt or modulate the model, turning it into a task-conditional language model. We introduce a new way for combining the two types of learning based on the idea of reranking language model samples, and show that this method outperforms others in communicating with humans in a visual referential communication task. Finally, we present a taxonomy of different types of language drift that can occur alongside a set of measures to detect them.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingRerankingSimilar Papers 제목 키워드 기반
Countering Language Drift via Visual Grounding
Emergent multi-agent communication protocols are very different from natural language and not easily interpretable by humans. We find that agents that were initially pretrained to produce natural language can also experi…
Language ModelingLanguage ModellingTranslationVisual GroundingToward Collaborative Reinforcement Learning Agents that Communicate Through Text-Based Natural Language
Communication between agents in collaborative multi-agent settings is in general implicit or a direct data stream. This paper considers text-based natural language as a novel form of communication between multiple agents…
Navigatereinforcement-learningReinforcement LearningReinforcement Learning (RL)SMAC-Talk: A Natural Language Extension of the StarCraft Multi-Agent Challenge for Large Language Models
As LLMs become more widely deployed, they are increasingly expected to work alongside other AI agents rather than operating in isolation. Effective coordination in these settings requires agents to communicate, share inf…
Decision MakingAgentic AI for Behavior-Driven Development Testing Using Large Language Models
Behavior-driven development (BDD) testing significantly improves communication and collaboration between developers, testers and business stakeholders, and ensures that software functionality meets business requirements.…
Computational EfficiencyTest Case CreationBeyond Natural Language: LLMs Leveraging Alternative Formats for Enhanced Reasoning and Communication
Natural language (NL) has long been the predominant format for human cognition and communication, and by extension, has been similarly pivotal in the development and application of Large Language Models (LLMs). Yet, besi…