paper-with-me

Papers

Annular Computational Imaging: Capture Clear Panoramic Images through Simple Lens

2022-06-13 · Qi Jiang, Hao Shi, Lei Sun, Shaohua Gao, Kailun Yang, Kaiwei Wang

Panoramic Annular Lens (PAL) composed of few lenses has great potential in panoramic surrounding sensing tasks for mobile and wearable devices because of its tiny size and large Field of View (FoV). However, the image quality of tiny-volume PAL confines to optical limit due to the lack of lenses for aberration correction. In this paper, we propose an Annular Computational Imaging (ACI) framework to break the optical limit of light-weight PAL design. To facilitate learning-based image restoration, we introduce a wave-based simulation pipeline for panoramic imaging and tackle the synthetic-to-real gap through multiple data distributions. The proposed pipeline can be easily adapted to any PAL with design parameters and is suitable for loose-tolerance designs. Furthermore, we design the Physics Informed Image Restoration Network (PI2RNet) considering the physical priors of panoramic imaging and single-pass physics-informed engine. At the dataset level, we create the DIVPano dataset and the extensive experiments on it illustrate that our proposed network sets the new state of the art in the panoramic image restoration under spatially-variant degradation. In addition, the evaluation of the proposed ACI on a simple PAL with only 3 spherical lenses reveals the delicate balance between high-quality panoramic imaging and compact design. To the best of our knowledge, we are the first to explore Computational Imaging (CI) in PAL. Code and datasets are publicly available at https://github.com/zju-jiangqi/ACI-PI2RNet.

📄 PDF Abstract BibTeX arXiv:2206.06070

Code (1)

zju-jiangqi/aci-pi2rnet 공식 구현 pytorch

Tasks

Image Restoration

Similar Papers 제목 키워드 기반

Design, analysis, and manufacturing of a glass-plastic hybrid minimalist aspheric panoramic annular lens

2024-05-05 · Shaohua Gao, Qi Jiang, Yiqi Liao, Yi Qiu 외

We propose a high-performance glass-plastic hybrid minimalist aspheric panoramic annular lens (ASPAL) to solve several major limitations of the traditional panoramic annular lens (PAL), such as large size, high weight, a…

Aerial-PASS: Panoramic Annular Scene Segmentation in Drone Videos

2021-05-15 · Lei Sun, Jia Wang, Kailun Yang, Kaikai Wu 외

Aerial pixel-wise scene perception of the surrounding environment is an important task for UAVs (Unmanned Aerial Vehicles). Previous research works mainly adopt conventional pinhole cameras or fisheye cameras as the imag…

Scene ParsingScene SegmentationSegmentationSemantic Segmentation

Panoramic Annular Localizer: Tackling the Variation Challenges of Outdoor Localization Using Panoramic Annular Images and Active Deep Descriptors

2019-05-14 · Ruiqi Cheng, Kaiwei Wang, Shufei Lin, Weijian Hu 외

Visual localization is an attractive problem that estimates the camera localization from database images based on the query image. It is a crucial task for various applications, such as autonomous vehicles, assistive nav…

Autonomous VehiclesCamera LocalizationOutdoor LocalizationVisual Localization

Minimalist and High-Quality Panoramic Imaging with PSF-aware Transformers

2023-06-22 · Qi Jiang, Shaohua Gao, Yao Gao, Kailun Yang 외

High-quality panoramic images with a Field of View (FoV) of 360{\deg} are essential for contemporary panoramic computer vision tasks. However, conventional imaging systems come with sophisticated lens designs and heavy o…

Super-Resolution

Panoramic annular SLAM with loop closure and global optimization

2021-02-26 · Hao Chen, Weijian Hu, Kailun Yang, Jian Bai 외

In this paper, we propose panoramic annular simultaneous localization and mapping (PA-SLAM), a visual SLAM system based on panoramic annular lens. A hybrid point selection strategy is put forward in the tracking front-en…

global-optimizationLoop Closure DetectionSimultaneous Localization and Mapping