Generalized Object Detection on Fisheye Cameras for Autonomous Driving: Dataset, Representations and Baseline
Object detection is a comprehensively studied problem in autonomous driving. However, it has been relatively less explored in the case of fisheye cameras. The standard bounding box fails in fisheye cameras due to the strong radial distortion, particularly in the image's periphery. We explore better representations like oriented bounding box, ellipse, and generic polygon for object detection in fisheye images in this work. We use the IoU metric to compare these representations using accurate instance segmentation ground truth. We design a novel curved bounding box model that has optimal properties for fisheye distortion models. We also design a curvature adaptive perimeter sampling method for obtaining polygon vertices, improving relative mAP score by 4.9% compared to uniform sampling. Overall, the proposed polygon model improves mIoU relative accuracy by 40.3%. It is the first detailed study on object detection on fisheye cameras for autonomous driving scenarios to the best of our knowledge. The dataset comprising of 10,000 images along with all the object representations ground truth will be made public to encourage further research. We summarize our work in a short video with qualitative results at https://youtu.be/iLkOzvJpL-A.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingInstance SegmentationObjectobject-detectionObject DetectionSemantic SegmentationSimilar Papers 제목 키워드 기반
FisheyeDetNet: 360° Surround view Fisheye Camera based Object Detection System for Autonomous Driving
Object detection is a mature problem in autonomous driving with pedestrian detection being one of the first deployed algorithms. It has been comprehensively studied in the literature. However, object detection is relativ…
ARCAutonomous DrivingInstance SegmentationObject+4FisheyeMODNet: Moving Object detection on Surround-view Cameras for Autonomous Driving
Moving Object Detection (MOD) is an important task for achieving robust autonomous driving. An autonomous vehicle has to estimate collision risk with other interacting objects in the environment and calculate an optional…
Autonomous DrivingDecision MakingMoving Object Detectionobject-detection+1Woodscape Fisheye Object Detection for Autonomous Driving -- CVPR 2022 OmniCV Workshop Challenge
Object detection is a comprehensively studied problem in autonomous driving. However, it has been relatively less explored in the case of fisheye cameras. The strong radial distortion breaks the translation invariance in…
Autonomous DrivingInductive BiasObjectobject-detection+1Spherical formulation of moving object geometric constraints for monocular fisheye cameras
In this paper, we introduce a moving object detection algorithm for fisheye cameras used in autonomous driving. We reformulate the three commonly used constraints in rectilinear images (epipolar, positive depth and posit…
Autonomous DrivingMoving Object Detectionobject-detectionObject DetectionBenchmarking Multi-View BEV Object Detection with Mixed Pinhole and Fisheye Cameras
Modern autonomous driving systems increasingly rely on mixed camera configurations with pinhole and fisheye cameras for full view perception. However, Bird's-Eye View (BEV) 3D object detection models are predominantly de…
3D Object DetectionAutonomous Driving