paper-with-me

Papers

COMPASS: Cooperative Multi-Agent Persistent Monitoring using Spatio-Temporal Attention Network

2025-07-22 · Xingjian Zhang, Yizhuo Wang, Guillaume Sartoretti arxiv

Persistent monitoring of dynamic targets is essential in real-world applications such as disaster response, environmental sensing, and wildlife conservation, where mobile agents must continuously gather information under uncertainty. We propose COMPASS, a multi-agent reinforcement learning (MARL) framework that enables decentralized agents to persistently monitor multiple moving targets efficiently. We model the environment as a graph, where nodes represent spatial locations and edges capture topological proximity, allowing agents to reason over structured layouts and revisit informative regions as needed. Each agent independently selects actions based on a shared spatio-temporal attention network that we design to integrate historical observations and spatial context. We model target dynamics using Gaussian Processes (GPs), which support principled belief updates and enable uncertainty-aware planning. We train COMPASS using centralized value estimation and decentralized policy execution under an adaptive reward setting. Our extensive experiments demonstrate that COMPASS consistently outperforms strong baselines in uncertainty reduction, target coverage, and coordination efficiency across dynamic multi-target scenarios.

📄 PDF Abstract BibTeX arXiv:2507.16306

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement LearningGaussian Processes

Similar Papers 제목 키워드 기반

Cooperative Informative Sensing for Monitoring Dynamic Indoor Environments via Multi-Agent Reinforcement Learning

2026-04-25 · Kanghoon Lee, Matthew M. Sato, Jinnyeong Yang, Seungro Lee 외 arxiv

Monitoring human activity in indoor environments is important for applications such as facility management, safety assessment, and space utilization analysis. While mobile robot teams offer the potential to actively impr…

Multi-agent Reinforcement Learning

Cooperative Multi-Agent Planning with Adaptive Skill Synthesis

2025-02-14 · Zhiyuan Li, Wenshuai Zhao, Joni Pajarinen

Despite much progress in training distributed artificial intelligence (AI), building cooperative multi-agent systems with multi-agent reinforcement learning (MARL) faces challenges in sample efficiency, interpretability,…

Decision MakingMulti-agent Reinforcement LearningStarcraft

AgentCompass: Towards Reliable Evaluation of Agentic Workflows in Production

2025-09-18 · NVJK Kartik, Garvit Sapra, Rishav Hada, Nikhil Pareek arxiv

With the growing adoption of Large Language Models (LLMs) in automating complex, multi-agent workflows, organizations face mounting risks from errors, emergent behaviors, and systemic failures that current evaluation met…

Continual Learning

Multi-Agent Reinforcement Learning for Visibility-based Persistent Monitoring

2020-11-02 · Jingxi Chen, Amrish Baskaran, Zhongshun Zhang, Pratap Tokekar

The Visibility-based Persistent Monitoring (VPM) problem seeks to find a set of trajectories (or controllers) for robots to persistently monitor a changing environment. Each robot has a sensor, such as a camera, with a l…

Graph AttentionMulti-agent Reinforcement Learningreinforcement-learningReinforcement Learning+1

Event-Driven Receding Horizon Control of Energy-Aware Dynamic Agents For Distributed Persistent Monitoring

2021-02-25 · Shirantha Welikala, Christos G. Cassandras

This paper addresses the persistent monitoring problem defined on a network where a set of nodes (targets) needs to be monitored by a team of dynamic energy-aware agents. The objective is to control the agents' motion to…