Geometry aware convolutional filters for omnidirectional images representation
Due to their wide field of view, omnidirectional cameras are frequently used by autonomous vehicles, drones and robots for navigation and other computer vision tasks. The images captured by such cameras, are often analysed and classified with techniques designed for planar images that unfortunately fail to properly handle the native geometry of such images. That results in suboptimal performance, and lack of truly meaningful visual features. In this paper we aim at improving popular deep convolutional neural networks so that they can properly take into account the specific properties of omnidirectional data. In particular we propose an algorithm that adapts convolutional layers, which often serve as a core building block of a CNN, to the properties of omnidirectional images. Thus, our filters have a shape and size that adapts with the location on the omnidirectional image. We show that our method is not limited to spherical surfaces and is able to incorporate the knowledge about any kind of omnidirectional geometry inside the deep learning network. As depicted by our experiments, our method outperforms the existing deep neural network techniques for omnidirectional image classification and compression tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous Vehiclesimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
Graph-Based Classification of Omnidirectional Images
Omnidirectional cameras are widely used in such areas as robotics and virtual reality as they provide a wide field of view. Their images are often processed with classical methods, which might unfortunately lead to non-o…
ClassificationGeneral Classificationgraph constructionimage-classification+1SphereNet: Learning Spherical Representations for Detection and Classification in Omnidirectional Images
Omnidirectional cameras offer great benefits over classical cameras wherever a wide field of view is essential, such as in virtual reality applications or in autonomous robots. Unfortunately, standard convolutional neura…
General Classificationimage-classificationImage Classificationobject-detection+1OSLO: On-the-Sphere Learning for Omnidirectional images and its application to 360-degree image compression
State-of-the-art 2D image compression schemes rely on the power of convolutional neural networks (CNNs). Although CNNs offer promising perspectives for 2D image compression, extending such models to omnidirectional image…
Image CompressionDistortion-Aware Convolutional Filters for Dense Prediction in Panoramic Images
There is a high demand of 3D data for 360° panoramic images and videos, pushed by the growing availability on the market of specialized hardware for both capturing (e.g., omnidirectional cameras) as well as visualizing …
Depth EstimationSemantic SegmentationStyle TransferCubes3D: Neural Network based Optical Flow in Omnidirectional Image Scenes
Optical flow estimation with convolutional neural networks (CNNs) has recently solved various tasks of computer vision successfully. In this paper we adapt a state-of-the-art approach for optical flow estimation to omnid…
ObjectOptical Flow Estimation