mmCooper: A Multi-agent Multi-stage Communication-efficient and Collaboration-robust Cooperative Perception Framework

2025-01-21 · Bingyi Liu, Jian Teng, Hongfei Xue, Enshu Wang, Chuanhui Zhu, Pu Wang, Libing Wu

Collaborative perception significantly enhances individual vehicle perception performance through the exchange of sensory information among agents. However, real-world deployment faces challenges due to bandwidth constraints and inevitable calibration errors during information exchange. To address these issues, we propose mmCooper, a novel multi-agent, multi-stage, communication-efficient, and collaboration-robust cooperative perception framework. Our framework leverages a multi-stage collaboration strategy that dynamically and adaptively balances intermediate- and late-stage information to share among agents, enhancing perceptual performance while maintaining communication efficiency. To support robust collaboration despite potential misalignments and calibration errors, our framework captures multi-scale contextual information for robust fusion in the intermediate stage and calibrates the received detection results to improve accuracy in the late stage. We validate the effectiveness of mmCooper through extensive experiments on real-world and simulated datasets. The results demonstrate the superiority of our proposed framework and the effectiveness of each component.

📄 PDF Abstract BibTeX arXiv:2501.12263

Code (0)

등록된 구현이 없습니다.

Context-aware Communication for Multi-agent Reinforcement Learning

2023-12-25 · Xinran Li, Jun Zhang

Effective communication protocols in multi-agent reinforcement learning (MARL) are critical to fostering cooperation and enhancing team performance. To leverage communication, many previous works have proposed to compres…

Multi-agent Reinforcement Learning Quantization reinforcement-learning Reinforcement Learning

Multi-Agent Stage-wise Conservative Linear Bandits

2025-10-01 · Amirhossein Afsharrad, Ahmadreza Moradipari, Sanjay Lall arxiv

In many real-world applications such as recommendation systems, multiple learning agents must balance exploration and exploitation while maintaining safety guarantees to avoid catastrophic failures. We study the stochast…

Recommendation Systems

HyLaT: Efficient Multi-Agent Communication via Hybrid Latent-Text Protocol

2026-05-25 · Xinyi Mou, Siyuan Wang, Zejun Li, Yulan He 외 arxiv

Communication protocol design is a central challenge in large language model-based multi-agent systems. Existing single-channel approaches face an inherent communication trilemma: text-based methods are interpretable but…

Who2com: Collaborative Perception via Learnable Handshake Communication

2020-03-21 · Yen-Cheng Liu, Junjiao Tian, Chih-Yao Ma, Nathan Glaser 외

In this paper, we propose the problem of collaborative perception, where robots can combine their local observations with those of neighboring agents in a learnable way to improve accuracy on a perception task. Unlike ex…

Multi-agent Reinforcement Learning Reinforcement Learning Scene Understanding Semantic Segmentation

A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration

2023-10-03 · Zijun Liu, Yanzhe Zhang, Peng Li, Yang Liu 외

Recent studies show that collaborating multiple large language model (LLM) powered agents is a promising way for task solving. However, current approaches are constrained by using a fixed number of agents and static comm…

Arithmetic Reasoning Code Generation HumanEval Language Modeling+4