TIGER-MARL: Enhancing Multi-Agent Reinforcement Learning with Temporal Information through Graph-based Embeddings and Representations

2025-11-11 · Nikunj Gupta, Ludwika Twardecka, James Zachary Hare, Jesse Milzman, Rajgopal Kannan, Viktor Prasanna arxiv

In this paper, we propose capturing and utilizing \textit{Temporal Information through Graph-based Embeddings and Representations} or \textbf{TIGER} to enhance multi-agent reinforcement learning (MARL). We explicitly model how inter-agent coordination structures evolve over time. While most MARL approaches rely on static or per-step relational graphs, they overlook the temporal evolution of interactions that naturally arise as agents adapt, move, or reorganize cooperation strategies. Capturing such evolving dependencies is key to achieving robust and adaptive coordination. To this end, TIGER constructs dynamic temporal graphs of MARL agents, connecting their current and historical interactions. It then employs a temporal attention-based encoder to aggregate information across these structural and temporal neighborhoods, yielding time-aware agent embeddings that guide cooperative policy learning. Through extensive experiments on two coordination-intensive benchmarks, we show that TIGER consistently outperforms diverse value-decomposition and graph-based MARL baselines in task performance and sample efficiency. Furthermore, we conduct comprehensive ablation studies to isolate the impact of key design parameters in TIGER, revealing how structural and temporal factors can jointly shape effective policy learning in MARL. All codes can be found here: https://github.com/Nikunj-Gupta/tiger-marl.

📄 PDF Abstract BibTeX arXiv:2511.08832

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning

Enhancing the Robustness of QMIX against State-adversarial Attacks

2023-07-03 · Weiran Guo, Guanjun Liu, Ziyuan Zhou, Ling Wang 외

Deep reinforcement learning (DRL) performance is generally impacted by state-adversarial attacks, a perturbation applied to an agent's observation. Most recent research has concentrated on robust single-agent reinforceme…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

The Synergy Between Optimal Transport Theory and Multi-Agent Reinforcement Learning

2024-01-18 · Ali Baheri, Mykel J. Kochenderfer

This paper explores the integration of optimal transport (OT) theory with multi-agent reinforcement learning (MARL). This integration uses OT to handle distributions and transportation problems to enhance the efficiency,…

Management Multi-agent Reinforcement Learning

Attention-Driven Multi-Agent Reinforcement Learning: Enhancing Decisions with Expertise-Informed Tasks

2024-04-08 · Andre R Kuroswiski, Annie S Wu, Angelo Passaro

In this paper, we introduce an alternative approach to enhancing Multi-Agent Reinforcement Learning (MARL) through the integration of domain knowledge and attention-based policy mechanisms. Our methodology focuses on the…

Decision Making Multi-agent Reinforcement Learning

LAMARL: LLM-Aided Multi-Agent Reinforcement Learning for Cooperative Policy Generation

2025-06-02 · Guobin Zhu, Rui Zhou, Wenkang Ji, Shiyu Zhao

Although Multi-Agent Reinforcement Learning (MARL) is effective for complex multi-robot tasks, it suffers from low sample efficiency and requires iterative manual reward tuning. Large Language Models (LLMs) have shown pr…

Multi-agent Reinforcement Learning

ClusterComm: Discrete Communication in Decentralized MARL using Internal Representation Clustering

2024-01-07 · Robert Müller, Hasan Turalic, Thomy Phan, Michael Kölle 외

In the realm of Multi-Agent Reinforcement Learning (MARL), prevailing approaches exhibit shortcomings in aligning with human learning, robustness, and scalability. Addressing this, we introduce ClusterComm, a fully decen…

Clustering Multi-agent Reinforcement Learning reinforcement-learning