paper-with-me

Papers

Long-range Turbulence Mitigation: A Large-scale Dataset and A Coarse-to-fine Framework

2024-07-11 · Shengqi Xu, Run Sun, Yi Chang, Shuning Cao, Xueyao Xiao, Luxin Yan

Long-range imaging inevitably suffers from atmospheric turbulence with severe geometric distortions due to random refraction of light. The further the distance, the more severe the disturbance. Despite existing research has achieved great progress in tackling short-range turbulence, there is less attention paid to long-range turbulence with significant distortions. To address this dilemma and advance the field, we construct a large-scale real long-range atmospheric turbulence dataset (RLR-AT), including 1500 turbulence sequences spanning distances from 1 Km to 13 Km. The advantages of RLR-AT compared to existing ones: turbulence with longer-distances and higher-diversity, scenes with greater-variety and larger-scale. Moreover, most existing work adopts either registration-based or decomposition-based methods to address distortions through one-step mitigation. However, they fail to effectively handle long-range turbulence due to its significant pixel displacements. In this work, we propose a coarse-to-fine framework to handle severe distortions, which cooperates dynamic turbulence and static background priors (CDSP). On the one hand, we discover the pixel motion statistical prior of turbulence, and propose a frequency-aware reference frame for better large-scale distortion registration, greatly reducing the burden of refinement. On the other hand, we take advantage of the static prior of background, and propose a subspace-based low-rank tensor refinement model to eliminate the misalignments inevitably left by registration while well preserving details. The dynamic and static priors complement to each other, facilitating us to progressively mitigate long-range turbulence with severe distortions. Extensive experiments demonstrate that the proposed method outperforms SOTA methods on different datasets.

📄 PDF Abstract BibTeX arXiv:2407.08377

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Spatio-Temporal Turbulence Mitigation: A Translational Perspective

2024-01-08 · CVPR 2024 1 · Xingguang Zhang, Nicholas Chimitt, Yiheng Chi, Zhiyuan Mao 외

Recovering images distorted by atmospheric turbulence is a challenging inverse problem due to the stochastic nature of turbulence. Although numerous turbulence mitigation (TM) algorithms have been proposed, their efficie…

Imaging through the Atmosphere using Turbulence Mitigation Transformer

2022-07-13 · Xingguang Zhang, Zhiyuan Mao, Nicholas Chimitt, Stanley H. Chan

Restoring images distorted by atmospheric turbulence is a ubiquitous problem in long-range imaging applications. While existing deep-learning-based methods have demonstrated promising results in specific testing conditio…

Video Restoration

Learning Phase Distortion with Selective State Space Models for Video Turbulence Mitigation

2025-04-03 · CVPR 2025 1 · Xingguang Zhang, Nicholas Chimitt, Xijun Wang, Yu Yuan 외

Atmospheric turbulence is a major source of image degradation in long-range imaging systems. Although numerous deep learning-based turbulence mitigation (TM) methods have been proposed, many are slow, memory-hungry, and …

State Space Models

Application of Tilt Correlation Statistics to Anisoplanatic Optical Turbulence Modeling and Mitigation

2021-08-01 · Russell C. Hardie, Michael A. Rucci, Santasri Bose-Pillai, Richard Van Hook

Atmospheric optical turbulence can be a significant source of image degradation, particularly in long range imaging applications. Many turbulence mitigation algorithms rely on an optical transfer function (OTF) model tha…

Image Registrationparameter estimation

DeTurb: Atmospheric Turbulence Mitigation with Deformable 3D Convolutions and 3D Swin Transformers

2024-07-30 · Zhicheng Zou, Nantheera Anantrasirichai

Atmospheric turbulence in long-range imaging significantly degrades the quality and fidelity of captured scenes due to random variations in both spatial and temporal dimensions. These distortions present a formidable cha…

AstronomyVideo Restoration