Object Detection in Equirectangular Panorama
We introduced a high-resolution equirectangular panorama (360-degree, virtual reality) dataset for object detection and propose a multi-projection variant of YOLO detector. The main challenge with equirectangular panorama image are i) the lack of annotated training data, ii) high-resolution imagery and iii) severe geometric distortions of objects near the panorama projection poles. In this work, we solve the challenges by i) using training examples available in the "conventional datasets" (ImageNet and COCO), ii) employing only low-resolution images that require only moderate GPU computing power and memory, and iii) our multi-projection YOLO handles projection distortions by making multiple stereographic sub-projections. In our experiments, YOLO outperforms the other state-of-art detector, Faster RCNN and our multi-projection YOLO achieves the best accuracy with low-resolution input.
Code (2)
Tasks
GPUObjectobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
PanoSwin: a Pano-style Swin Transformer for Panorama Understanding
In panorama understanding, the widely used equirectangular projection (ERP) entails boundary discontinuity and spatial distortion. It severely deteriorates the conventional CNNs and vision Transformers on panoramas. In t…
ERPobject-detectionObject DetectionTransfer LearningSphereFusion: Efficient Panorama Depth Estimation via Gated Fusion
Due to the rapid development of panorama cameras, the task of estimating panorama depth has attracted significant attention from the computer vision community, especially in applications such as robot sensing and autonom…
Autonomous DrivingDepth EstimationSE360: Semantic Edit in 360$^\circ$ Panoramas via Hierarchical Data Construction
While instruction-based image editing is emerging, extending it to 360$^\circ$ panoramas introduces additional challenges. Existing methods often produce implausible results in both equirectangular projections (ERP) and …
Image Editing${S}^{2}$Net: Accurate Panorama Depth Estimation on Spherical Surface
Monocular depth estimation is an ambiguous problem, thus global structural cues play an important role in current data-driven single-view depth estimation methods. Panorama images capture the complete spatial information…
DecoderDepth EstimationMonocular Depth EstimationSliceNet: Deep Dense Depth Estimation From a Single Indoor Panorama Using a Slice-Based Representation
We introduce a novel deep neural network to estimate a depth map from a single monocular indoor panorama. The network directly works on the equirectangular projection, exploiting the properties of indoor 360 images. …
Depth Estimation