LTT-GAN: Looking Through Turbulence by Inverting GANs
In many applications of long-range imaging, we are faced with a scenario where a person appearing in the captured imagery is often degraded by atmospheric turbulence. However, restoring such degraded images for face verification is difficult since the degradation causes images to be geometrically distorted and blurry. To mitigate the turbulence effect, in this paper, we propose the first turbulence mitigation method that makes use of visual priors encapsulated by a well-trained GAN. Based on the visual priors, we propose to learn to preserve the identity of restored images on a spatial periodic contextual distance. Such a distance can keep the realism of restored images from the GAN while considering the identity difference at the network learning. In addition, hierarchical pseudo connections are proposed for facilitating the identity-preserving learning by introducing more appearance variance without identity changing. Extensive experiments show that our method significantly outperforms prior art in both the visual quality and face verification accuracy of restored results.
Code (0)
등록된 구현이 없습니다.
Tasks
Face VerificationSimilar Papers 제목 키워드 기반
Improving generative adversarial network inversion via fine-tuning GAN encoders
Generative adversarial networks (GANs) can synthesize high-quality (HQ) images, and GAN inversion is a technique that discovers how to invert given images back to latent space. While existing methods perform on StyleGAN …
Generative Adversarial NetworkImage ReconstructionTowards prediction of turbulent flows at high Reynolds numbers using high performance computing data and deep learning
In this paper, deep learning (DL) methods are evaluated in the context of turbulent flows. Various generative adversarial networks (GANs) are discussed with respect to their suitability for understanding and modeling tur…
Vocal Bursts Intensity PredictionJoIN: Joint GANs Inversion for Intrinsic Image Decomposition
In this work, we propose to solve ill-posed inverse imaging problems using a bank of Generative Adversarial Networks (GAN) as a prior and apply our method to the case of Intrinsic Image Decomposition for faces and materi…
Image RelightingIntrinsic Image DecompositionPhysics-Constrained Generative Adversarial Networks for 3D Turbulence
Generative Adversarial Networks (GANs) have received wide acclaim among the machine learning (ML) community for their ability to generate realistic 2D images. ML is being applied more often to complex problems beyond tho…
Inverting The Generator Of A Generative Adversarial Network (II)
Generative adversarial networks (GANs) learn a deep generative model that is able to synthesise novel, high-dimensional data samples. New data samples are synthesised by passing latent samples, drawn from a chosen prior …
Generative Adversarial NetworkRetrieval