When2com: Multi-Agent Perception via Communication Graph Grouping
While significant advances have been made for single-agent perception, many applications require multiple sensing agents and cross-agent communication due to benefits such as coverage and robustness. It is therefore critical to develop frameworks which support multi-agent collaborative perception in a distributed and bandwidth-efficient manner. In this paper, we address the collaborative perception problem, where one agent is required to perform a perception task and can communicate and share information with other agents on the same task. Specifically, we propose a communication framework by learning both to construct communication groups and decide when to communicate. We demonstrate the generalizability of our framework on two different perception tasks and show that it significantly reduces communication bandwidth while maintaining superior performance.
Code (2)
Similar Papers 제목 키워드 기반
Scalable Perception-Action-Communication Loops with Convolutional and Graph Neural Networks
In this paper, we present a perception-action-communication loop design using Vision-based Graph Aggregation and Inference (VGAI). This multi-agent decentralized learning-to-control framework maps raw visual observations…
Graph Neural NetworkImitation LearningMulti-agent Collaborative Perception via Motion-aware Robust Communication Network
Collaborative perception allows for information sharing between multiple agents such as vehicles and infrastructure to obtain a comprehensive view of the environment through communication and fusion. Current research…
3D Object Detectionobject-detectionObject DetectionInterruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Driving
Cooperative perception can significantly improve the perception performance of autonomous vehicles beyond the limited perception ability of individual vehicles by exchanging information with neighbor agents through V2X c…
Autonomous DrivingAutonomous VehiclesKnowledge DistillationBridging the Domain Gap for Multi-Agent Perception
Existing multi-agent perception algorithms usually select to share deep neural features extracted from raw sensing data between agents, achieving a trade-off between accuracy and communication bandwidth limit. However, t…
3D Object DetectionDomain Adaptationobject-detectionObject DetectionWhen Autonomous Vehicle Meets V2X Cooperative Perception: How Far Are We?
With the tremendous advancement of deep learning and communication technology, Vehicle-to-Everything (V2X) cooperative perception has the potential to address limitations in sensing distant objects and occlusion for a si…