Enhanced Cooperative Perception for Autonomous Vehicles Using Imperfect Communication
Sharing and joint processing of camera feeds and sensor measurements, known as Cooperative Perception (CP), has emerged as a new technique to achieve higher perception qualities. CP can enhance the safety of Autonomous Vehicles (AVs) where their individual visual perception quality is compromised by adverse weather conditions (haze as foggy weather), low illumination, winding roads, and crowded traffic. To cover the limitations of former methods, in this paper, we propose a novel approach to realize an optimized CP under constrained communications. At the core of our approach is recruiting the best helper from the available list of front vehicles to augment the visual range and enhance the Object Detection (OD) accuracy of the ego vehicle. In this two-step process, we first select the helper vehicles that contribute the most to CP based on their visual range and lowest motion blur. Next, we implement a radio block optimization among the candidate vehicles to further improve communication efficiency. We specifically focus on pedestrian detection as an exemplary scenario. To validate our approach, we used the CARLA simulator to create a dataset of annotated videos for different driving scenarios where pedestrian detection is challenging for an AV with compromised vision. Our results demonstrate the efficacy of our two-step optimization process in improving the overall performance of cooperative perception in challenging scenarios, substantially improving driving safety under adverse conditions. Finally, we note that the networking assumptions are adopted from LTE Release 14 Mode 4 side-link communication, commonly used for Vehicle-to-Vehicle (V2V) communication. Nonetheless, our method is flexible and applicable to arbitrary V2V communications.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous Vehiclesobject-detectionObject DetectionPedestrian DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unveiling Uncertainty-Aware Autonomous Cooperative Learning Based Planning Strategy
In future intelligent transportation systems, autonomous cooperative planning (ACP), becomes a promising technique to increase the effectiveness and security of multi-vehicle interactions. However, multiple uncertainties…
Reinforcement LearningAutonomous VehiclesMotion PlanningInterruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Driving
Cooperative perception can significantly improve the perception performance of autonomous vehicles beyond the limited perception ability of individual vehicles by exchanging information with neighbor agents through V2X c…
Autonomous DrivingAutonomous VehiclesKnowledge DistillationAnomaly Detection in Cooperative Vehicle Perception Systems under Imperfect Communication
Anomaly detection is a critical requirement for ensuring safety in autonomous driving. In this work, we leverage Cooperative Perception to share information across nearby vehicles, enabling more accurate identification a…
Anomaly ClassificationAnomaly DetectionAutonomous DrivingWHALES: A Multi-agent Scheduling Dataset for Enhanced Cooperation in Autonomous Driving
Achieving high levels of safety and reliability in autonomous driving remains a critical challenge, especially due to occlusion and limited perception ranges in standalone systems. Cooperative perception among vehicles o…
Autonomous DrivingAutonomous VehiclesSchedulingHuman-vehicle Cooperative Visual Perception for Autonomous Driving under Complex Road and Traffic Scenarios
Human-vehicle cooperative driving has become the critical technology of autonomous driving, which reduces the workload of human drivers. However, the complex and uncertain road environments bring great challenges to the …
Autonomous DrivingAutonomous Vehiclesobject-detectionObject Detection+1