Distortion-Aware Convolutional Filters for Dense Prediction in Panoramic Images
There is a high demand of 3D data for 360° panoramic images and videos, pushed by the growing availability on the market of specialized hardware for both capturing (e.g., omnidirectional cameras) as well as visualizing in 3D (e.g., head mounted displays) panoramic images and videos. At the same time, 3D sensors able to capture 3D panoramic data are expensive and/or hardly available. To fill this gap, we propose a learning approach for panoramic depth map estimation from a single image. Thanks to a specifically developed distortion-aware deformable convolution filter, our method can be trained by means of conventional perspective images, then used to regress depth for panoramic images, thus bypassing the effort needed to create annotated panoramic training dataset. We also demonstrate our approach for emerging tasks such as panoramic monocular SLAM, panoramic semantic segmentation and panoramic style transfer.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationSemantic SegmentationStyle TransferMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Revisiting 360 Depth Estimation with PanoGabor: A New Fusion Perspective
Depth estimation from a monocular 360 image is important to the perception of the entire 3D environment. However, the inherent distortion and large field of view (FoV) in 360 images pose great challenges for this task. T…
Depth EstimationERPSensitivityDeepCorrect: Correcting DNN models against Image Distortions
In recent years, the widespread use of deep neural networks (DNNs) has facilitated great improvements in performance for computer vision tasks like image classification and object recognition. In most realistic computer …
ClassificationGeneral Classificationimage-classificationImage Classification+2Segmentation-Aware Convolutional Networks Using Local Attention Masks
We introduce an approach to integrate segmentation information within a convolutional neural network (CNN). This counter-acts the tendency of CNNs to smooth information across regions and increases their spatial precisio…
Optical Flow EstimationSegmentationSemantic SegmentationExploring Temporal Preservation Networks for Precise Temporal Action Localization
Temporal action localization is an important task of computer vision. Though a variety of methods have been proposed, it still remains an open question how to predict the temporal boundaries of action segments precisely.…
Action LocalizationOpen-Ended Question AnsweringTemporal Action LocalizationTemporal LocalizationSphereNet: Learning Spherical Representations for Detection and Classification in Omnidirectional Images
Omnidirectional cameras offer great benefits over classical cameras wherever a wide field of view is essential, such as in virtual reality applications or in autonomous robots. Unfortunately, standard convolutional neura…
General Classificationimage-classificationImage Classificationobject-detection+1