RopeBEV: A Multi-Camera Roadside Perception Network in Bird's-Eye-View
Multi-camera perception methods in Bird's-Eye-View (BEV) have gained wide application in autonomous driving. However, due to the differences between roadside and vehicle-side scenarios, there currently lacks a multi-camera BEV solution in roadside. This paper systematically analyzes the key challenges in multi-camera BEV perception for roadside scenarios compared to vehicle-side. These challenges include the diversity in camera poses, the uncertainty in Camera numbers, the sparsity in perception regions, and the ambiguity in orientation angles. In response, we introduce RopeBEV, the first dense multi-camera BEV approach. RopeBEV introduces BEV augmentation to address the training balance issues caused by diverse camera poses. By incorporating CamMask and ROIMask (Region of Interest Mask), it supports variable camera numbers and sparse perception, respectively. Finally, camera rotation embedding is utilized to resolve orientation ambiguity. Our method ranks 1st on the real-world highway dataset RoScenes and demonstrates its practical value on a private urban dataset that covers more than 50 intersections and 600 cameras.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingDiversitySimilar Papers 제목 키워드 기반
BEVHeight: A Robust Framework for Vision-based Roadside 3D Object Detection
While most recent autonomous driving system focuses on developing perception methods on ego-vehicle sensors, people tend to overlook an alternative approach to leverage intelligent roadside cameras to extend the percepti…
3D Object DetectionAutonomous Drivingobject-detectionObject DetectionSGV3D:Towards Scenario Generalization for Vision-based Roadside 3D Object Detection
Roadside perception can greatly increase the safety of autonomous vehicles by extending their perception ability beyond the visual range and addressing blind spots. However, current state-of-the-art vision-based roadside…
3D Object DetectionAutonomous Vehiclesobject-detectionObject DetectionBEVHeight++: Toward Robust Visual Centric 3D Object Detection
While most recent autonomous driving system focuses on developing perception methods on ego-vehicle sensors, people tend to overlook an alternative approach to leverage intelligent roadside cameras to extend the percepti…
3D Object DetectionAutonomous DrivingObjectobject-detection+1RoCo-Sim: Enhancing Roadside Collaborative Perception through Foreground Simulation
Roadside Collaborative Perception refers to a system where multiple roadside units collaborate to pool their perceptual data, assisting vehicles in enhancing their environmental awareness. Existing roadside perception me…
3D Object Detectionobject-detectionObject DetectionStyle TransferMC-BEVRO: Multi-Camera Bird Eye View Road Occupancy Detection for Traffic Monitoring
Single camera 3D perception for traffic monitoring faces significant challenges due to occlusion and limited field of view. Moreover, fusing information from multiple cameras at the image feature level is difficult becau…