Deep Learning for Omnidirectional Vision: A Survey and New Perspectives
Omnidirectional image (ODI) data is captured with a 360x180 field-of-view, which is much wider than the pinhole cameras and contains richer spatial information than the conventional planar images. Accordingly, omnidirectional vision has attracted booming attention due to its more advantageous performance in numerous applications, such as autonomous driving and virtual reality. In recent years, the availability of customer-level 360 cameras has made omnidirectional vision more popular, and the advance of deep learning (DL) has significantly sparked its research and applications. This paper presents a systematic and comprehensive review and analysis of the recent progress in DL methods for omnidirectional vision. Our work covers four main contents: (i) An introduction to the principle of omnidirectional imaging, the convolution methods on the ODI, and datasets to highlight the differences and difficulties compared with the 2D planar image data; (ii) A structural and hierarchical taxonomy of the DL methods for omnidirectional vision; (iii) A summarization of the latest novel learning strategies and applications; (iv) An insightful discussion of the challenges and open problems by highlighting the potential research directions to trigger more research in the community.
Code (2)
Tasks
Autonomous DrivingDeep LearningSurveyMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Applications of Deep Learning for Top-View Omnidirectional Imaging: A Survey
A large field-of-view fisheye camera allows for capturing a large area with minimal numbers of cameras when they are mounted on a high position facing downwards. This top-view omnidirectional setup greatly reduces the wo…
Activity RecognitionDeep LearningMiscellaneousobject-detection+3A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Vision
Omnidirectional image (ODI) data is captured with a field-of-view of 360x180, which is much wider than the pinhole cameras and captures richer surrounding environment details than the conventional perspective images. In …
3D geometryAutonomous DrivingImage GenerationMotion Estimation+3One Flight Over the Gap: A Survey from Perspective to Panoramic Vision
Driven by the demand for spatial intelligence and holistic scene perception, omnidirectional images (ODIs), which provide a complete 360\textdegree{} field of view, are receiving growing attention across diverse applicat…
Autonomous DrivingDomain AdaptationOSLO: On-the-Sphere Learning for Omnidirectional images and its application to 360-degree image compression
State-of-the-art 2D image compression schemes rely on the power of convolutional neural networks (CNNs). Although CNNs offer promising perspectives for 2D image compression, extending such models to omnidirectional image…
Image CompressionAIGCOIQA2024: Perceptual Quality Assessment of AI Generated Omnidirectional Images
In recent years, the rapid advancement of Artificial Intelligence Generated Content (AIGC) has attracted widespread attention. Among the AIGC, AI generated omnidirectional images hold significant potential for Virtual Re…
Image Quality Assessment