LangMARL: Natural Language Multi-Agent Reinforcement Learning
Large language model (LLM) agents struggle to autonomously evolve coordination strategies in dynamic environments, largely because coarse global outcomes obscure the causal signals needed for local policy refinement. We identify this bottleneck as a multi-agent credit assignment problem, which has long been studied in classical multi-agent reinforcement learning (MARL) but remains underaddressed in LLM-based systems. Building on this observation, we propose LangMARL, a framework that brings credit assignment and policy gradient evolution from cooperative MARL into the language space. LangMARL introduces agent-level language credit assignment, pioneers gradient evolution in language space for policy improvement, and summarizes task-relevant causal relations from replayed trajectories to provide dense feedback and improve convergence under sparse rewards. Extensive experiments across diverse cooperative multi-agent tasks demonstrate improved sample efficiency, interpretability, and strong generalization.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-agent Reinforcement LearningSimilar Papers 제목 키워드 기반
Safe Multi-agent Reinforcement Learning with Natural Language Constraints
The role of natural language constraints in Safe Multi-agent Reinforcement Learning (MARL) is crucial, yet often overlooked. While Safe MARL has vast potential, especially in fields like robotics and autonomous vehicles,…
Autonomous VehiclesMulti-agent Reinforcement Learningreinforcement-learningReinforcement LearningToward Collaborative Reinforcement Learning Agents that Communicate Through Text-Based Natural Language
Communication between agents in collaborative multi-agent settings is in general implicit or a direct data stream. This paper considers text-based natural language as a novel form of communication between multiple agents…
Navigatereinforcement-learningReinforcement LearningReinforcement Learning (RL)Beating Atari with Natural Language Guided Reinforcement Learning
We introduce the first deep reinforcement learning agent that learns to beat Atari games with the aid of natural language instructions. The agent uses a multimodal embedding between environment observations and natural l…
Atari GamesDeep Reinforcement LearningMontezuma's RevengeOpenAI Gym+3Influencing Reinforcement Learning through Natural Language Guidance
Interactive reinforcement learning agents use human feedback or instruction to help them learn in complex environments. Often, this feedback comes in the form of a discrete signal that is either positive or negative. Whi…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)GLIDE-RL: Grounded Language Instruction through DEmonstration in RL
One of the final frontiers in the development of complex human - AI collaborative systems is the ability of AI agents to comprehend the natural language and perform tasks accordingly. However, training efficient Reinforc…
Continual Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)