Learning to restore images degraded by atmospheric turbulence using uncertainty
Atmospheric turbulence can significantly degrade the quality of images acquired by long-range imaging systems by causing spatially and temporally random fluctuations in the index of refraction of the atmosphere. Variations in the refractive index causes the captured images to be geometrically distorted and blurry. Hence, it is important to compensate for the visual degradation in images caused by atmospheric turbulence. In this paper, we propose a deep learning-based approach for restring a single image degraded by atmospheric turbulence. We make use of the epistemic uncertainty based on Monte Carlo dropouts to capture regions in the image where the network is having hard time restoring. The estimated uncertainty maps are then used to guide the network to obtain the restored image. Extensive experiments are conducted on synthetic and real images to show the significance of the proposed work. Code is available at : https://github.com/rajeevyasarla/AT-Net
Code (1)
Similar Papers 제목 키워드 기반
ATFaceGAN: Single Face Image Restoration and Recognition from Atmospheric Turbulence
Image degradation due to atmospheric turbulence is common while capturing images at long ranges. To mitigate the degradation due to turbulence which includes deformation and blur, we propose a generative single frame res…
DisentanglementFace RecognitionImage RestorationLearning to Restore a Single Face Image Degraded by Atmospheric Turbulence using CNNs
Atmospheric turbulence significantly affects imaging systems which use light that has propagated through long atmospheric paths. Images captured under such condition suffer from a combination of geometric deformation and…
LTT-GAN: Looking Through Turbulence by Inverting GANs
In many applications of long-range imaging, we are faced with a scenario where a person appearing in the captured imagery is often degraded by atmospheric turbulence. However, restoring such degraded images for face veri…
Face VerificationImpact of Atmospheric Turbulence and Pointing Error on Earth Observation
Earth Observation (EO) imagery is often degraded by atmospheric turbulence and pointing jitter; yet, these effects are rarely considered in datasets used to train AI-based detection models. Based on prior work, this pape…
Vessel DetectionPSF--NET: A Non-parametric Point Spread Function Model for Ground Based Optical Telescopes
Ground based optical telescopes are seriously affected by atmospheric turbulence induced aberrations. Understanding properties of these aberrations is important both for instruments design and image restoration methods d…
Image Restoration