paper-with-me

홈 › Papers

Attention Based Feature Fusion For Multi-Agent Collaborative Perception

2023-05-03 · Ahmed N. Ahmed, Siegfried Mercelis, Ali Anwar

In the domain of intelligent transportation systems (ITS), collaborative perception has emerged as a promising approach to overcome the limitations of individual perception by enabling multiple agents to exchange information, thus enhancing their situational awareness. Collaborative perception overcomes the limitations of individual sensors, allowing connected agents to perceive environments beyond their line-of-sight and field of view. However, the reliability of collaborative perception heavily depends on the data aggregation strategy and communication bandwidth, which must overcome the challenges posed by limited network resources. To improve the precision of object detection and alleviate limited network resources, we propose an intermediate collaborative perception solution in the form of a graph attention network (GAT). The proposed approach develops an attention-based aggregation strategy to fuse intermediate representations exchanged among multiple connected agents. This approach adaptively highlights important regions in the intermediate feature maps at both the channel and spatial levels, resulting in improved object detection precision. We propose a feature fusion scheme using attention-based architectures and evaluate the results quantitatively in comparison to other state-of-the-art collaborative perception approaches. Our proposed approach is validated using the V2XSim dataset. The results of this work demonstrate the efficacy of the proposed approach for intermediate collaborative perception in improving object detection average precision while reducing network resource usage.

📄 PDF Abstract BibTeX arXiv:2305.02061

Code (0)

등록된 구현이 없습니다.

Tasks

Graph AttentionObjectobject-detectionObject Detection

Similar Papers 제목 키워드 기반

EIMC: Efficient Instance-aware Multi-modal Collaborative Perception

2026-03-03 · Kang Yang, Peng Wang, Lantao Li, Tianci Bu 외 arxiv

Multi-modal collaborative perception calls for great attention to enhancing the safety of autonomous driving. However, current multi-modal approaches remain a ``local fusion to communication'' sequence, which fuses multi…

Autonomous Driving

Is Discretization Fusion All You Need for Collaborative Perception?

2025-03-18 · Kang Yang, Tianci Bu, Lantao Li, Chunxu Li 외

Collaborative perception in multi-agent system enhances overall perceptual capabilities by facilitating the exchange of complementary information among agents. Current mainstream collaborative perception methods rely on …

Allobject-detectionObject Detection

Generative Map Priors for Collaborative BEV Semantic Segmentation

2025-01-01 · CVPR 2025 1 · Jiahui Fu, Yue Gong, Luting Wang, Shifeng Zhang 외

Collaborative perception aims to address the constraint of single-agent perception by exchanging information among multiple agents. Previous works primarily focus on collaborative object detection, exploring compress…

Feature Compressionobject-detectionObject DetectionSemantic Segmentation

CoDiff: Conditional Diffusion Model for Collaborative 3D Object Detection

2025-02-17 · Zhe Huang, Shuo Wang, Yongcai Wang, Lei Wang

Collaborative 3D object detection holds significant importance in the field of autonomous driving, as it greatly enhances the perception capabilities of each individual agent by facilitating information exchange among mu…

3D Object DetectionAutonomous Drivingobject-detectionObject Detection+1

IFTR: An Instance-Level Fusion Transformer for Visual Collaborative Perception

2024-07-13 · Shaohong Wang, Lu Bin, Xinyu Xiao, Zhiyu Xiang 외

Multi-agent collaborative perception has emerged as a widely recognized technology in the field of autonomous driving in recent years. However, current collaborative perception predominantly relies on LiDAR point clouds,…

Autonomous Driving