Exploring Surround-View Fisheye Camera 3D Object Detection
In this work, we explore the technical feasibility of implementing end-to-end 3D object detection (3DOD) with surround-view fisheye camera system. Specifically, we first investigate the performance drop incurred when transferring classic pinhole-based 3D object detectors to fisheye imagery. To mitigate this, we then develop two methods that incorporate the unique geometry of fisheye images into mainstream detection frameworks: one based on the bird's-eye-view (BEV) paradigm, named FisheyeBEVDet, and the other on the query-based paradigm, named FisheyePETR. Both methods adopt spherical spatial representations to effectively capture fisheye geometry. In light of the lack of dedicated evaluation benchmarks, we release Fisheye3DOD, a new open dataset synthesized using CARLA and featuring both standard pinhole and fisheye camera arrays. Experiments on Fisheye3DOD show that our fisheye-compatible modeling improves accuracy by up to 6.2% over baseline methods.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionSimilar Papers 제목 키워드 기반
FisheyeDetNet: 360° Surround view Fisheye Camera based Object Detection System for Autonomous Driving
Object detection is a mature problem in autonomous driving with pedestrian detection being one of the first deployed algorithms. It has been comprehensively studied in the literature. However, object detection is relativ…
ARCAutonomous DrivingInstance SegmentationObject+4Surround-view Fisheye Camera Perception for Automated Driving: Overview, Survey and Challenges
Surround-view fisheye cameras are commonly used for near-field sensing in automated driving. Four fisheye cameras on four sides of the vehicle are sufficient to cover 360{\deg} around the vehicle capturing the entire nea…
object-detectionObject DetectionParking Spot Classification based on surround view camera system
Surround-view fisheye cameras are commonly used for near-field sensing in automated driving scenarios, including urban driving and auto valet parking. Four fisheye cameras, one on each side, are sufficient to cover 360{\…
Classificationobject-detectionObject DetectionSurround-View Fisheye Optics in Computer Vision and Simulation: Survey and Challenges
In this paper, we provide a survey on automotive surround-view fisheye optics, with an emphasis on the impact of optical artifacts on computer vision tasks in autonomous driving and ADAS. The automotive industry has adva…
Autonomous DrivingFisheyeMODNet: Moving Object detection on Surround-view Cameras for Autonomous Driving
Moving Object Detection (MOD) is an important task for achieving robust autonomous driving. An autonomous vehicle has to estimate collision risk with other interacting objects in the environment and calculate an optional…
Autonomous DrivingDecision MakingMoving Object Detectionobject-detection+1