SmartCooper: Vehicular Collaborative Perception with Adaptive Fusion and Judger Mechanism
In recent years, autonomous driving has garnered significant attention due to its potential for improving road safety through collaborative perception among connected and autonomous vehicles (CAVs). However, time-varying channel variations in vehicular transmission environments demand dynamic allocation of communication resources. Moreover, in the context of collaborative perception, it is important to recognize that not all CAVs contribute valuable data, and some CAV data even have detrimental effects on collaborative perception. In this paper, we introduce SmartCooper, an adaptive collaborative perception framework that incorporates communication optimization and a judger mechanism to facilitate CAV data fusion. Our approach begins with optimizing the connectivity of vehicles while considering communication constraints. We then train a learnable encoder to dynamically adjust the compression ratio based on the channel state information (CSI). Subsequently, we devise a judger mechanism to filter the detrimental image data reconstructed by adaptive decoders. We evaluate the effectiveness of our proposed algorithm on the OpenCOOD platform. Our results demonstrate a substantial reduction in communication costs by 23.10\% compared to the non-judger scheme. Additionally, we achieve a significant improvement on the average precision of Intersection over Union (AP@IoU) by 7.15\% compared with state-of-the-art schemes.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingAutonomous VehiclesSimilar Papers 제목 키워드 기반
Systematic Literature Review on Vehicular Collaborative Perception -- A Computer Vision Perspective
The effectiveness of autonomous vehicles relies on reliable perception capabilities. Despite significant advancements in artificial intelligence and sensor fusion technologies, current single-vehicle perception systems c…
ArticlesAutonomous VehiclesSensor FusionSystematic Literature ReviewDifferential Transformer-driven 6G Physical Layer for Collaborative Perception Enhancement
The emergence of 6G wireless networks promises to revolutionize vehicular communications by enabling ultra-reliable, low-latency, and high-capacity data exchange. In this context, collaborative perception techniques, whe…
Autonomous DrivingAutonomous VehiclesAdaptive Feature Fusion for Cooperative Perception using LiDAR Point Clouds
Cooperative perception allows a Connected Autonomous Vehicle (CAV) to interact with the other CAVs in the vicinity to enhance perception of surrounding objects to increase safety and reliability. It can compensate for th…
Domain Adaptationfeature selectionPedestrian Detectionvehicle detectionInfrastructure-Assisted Collaborative Perception in Automated Valet Parking: A Safety Perspective
Environmental perception in Automated Valet Parking (AVP) has been a challenging task due to severe occlusions in parking garages. Although Collaborative Perception (CP) can be applied to broaden the field of view of con…
Dimensionality ReductionQuantizationCoAdapt: An LLM-based Framework for Adaptive Collaborative Perception in IIoT Robotic Swarms
Industrial IoT environments increasingly deploy autonomous mobile robots for tasks such as material handling, product assembly, or infrastructure inspection. In such deployments, collaborative perception enables robots t…
Point Clouds