paper-with-me

홈 › Papers

Diffeomorphic Template Registration for Atmospheric Turbulence Mitigation

2024-05-06 · CVPR 2024 1 · Dong Lao, Congli Wang, Alex Wong, Stefano Soatto

We describe a method for recovering the irradiance underlying a collection of images corrupted by atmospheric turbulence. Since supervised data is often technically impossible to obtain, assumptions and biases have to be imposed to solve this inverse problem, and we choose to model them explicitly. Rather than initializing a latent irradiance ("template") by heuristics to estimate deformation, we select one of the images as a reference, and model the deformation in this image by the aggregation of the optical flow from it to other images, exploiting a prior imposed by Central Limit Theorem. Then with a novel flow inversion module, the model registers each image TO the template but WITHOUT the template, avoiding artifacts related to poor template initialization. To illustrate the robustness of the method, we simply (i) select the first frame as the reference and (ii) use the simplest optical flow to estimate the warpings, yet the improvement in registration is decisive in the final reconstruction, as we achieve state-of-the-art performance despite its simplicity. The method establishes a strong baseline that can be further improved by integrating it seamlessly into more sophisticated pipelines, or with domain-specific methods if so desired.

📄 PDF Abstract BibTeX arXiv:2405.03662

Code (0)

등록된 구현이 없습니다.

Tasks

Optical Flow Estimation

Similar Papers 제목 키워드 기반

Atmospheric turbulence restoration by diffeomorphic image registration and blind deconvolution

2024-11-12 · Jerome Gilles, Tristan Dagobert, Carlo de Franchis

A novel approach is presented in this paper to improve images which are altered by atmospheric turbulence. Two new algorithms are presented based on two combinations of a blind deconvolution block, an elastic registratio…

Image Registration

Long-range Turbulence Mitigation: A Large-scale Dataset and A Coarse-to-fine Framework

2024-07-11 · Shengqi Xu, Run Sun, Yi Chang, Shuning Cao 외

Long-range imaging inevitably suffers from atmospheric turbulence with severe geometric distortions due to random refraction of light. The further the distance, the more severe the disturbance. Despite existing research …

Application of Tilt Correlation Statistics to Anisoplanatic Optical Turbulence Modeling and Mitigation

2021-08-01 · Russell C. Hardie, Michael A. Rucci, Santasri Bose-Pillai, Richard Van Hook

Atmospheric optical turbulence can be a significant source of image degradation, particularly in long range imaging applications. Many turbulence mitigation algorithms rely on an optical transfer function (OTF) model tha…

Image Registrationparameter estimation

Spatio-Temporal Turbulence Mitigation: A Translational Perspective

2024-01-08 · CVPR 2024 1 · Xingguang Zhang, Nicholas Chimitt, Yiheng Chi, Zhiyuan Mao 외

Recovering images distorted by atmospheric turbulence is a challenging inverse problem due to the stochastic nature of turbulence. Although numerous turbulence mitigation (TM) algorithms have been proposed, their efficie…

NeRT: Implicit Neural Representations for General Unsupervised Turbulence Mitigation

2023-08-01 · Weiyun Jiang, Yuhao Liu, Vivek Boominathan, Ashok Veeraraghavan

The atmospheric and water turbulence mitigation problems have emerged as challenging inverse problems in computer vision and optics communities over the years. However, current methods either rely heavily on the quality …