Joint Face Super-Resolution and Deblurring Using a Generative Adversarial Network
Facial image super-resolution (SR) is an important preprocessing for facial image analysis, face recognition, and image-based 3D face reconstruction. Recent convolutional neural network (CNN) based method has shown excellent performance by learning mapping relation using pairs of low-resolution (LR) and high-resolution (HR) facial images. However, since the HR facial image reconstruction using CNN is conventionally aimed to increase the PSNR and SSIM metrics, the reconstructed HR image might not be realistic even with high scores. An adversarial framework is proposed in this study to reconstruct the HR facial image by simultaneously generating an HR image with and without blur. First, the spatial resolution of the LR facial image is increased by eight times using a five-layer CNN. Then, the encoder extracts the features of the up-scaled image. These features are finally sent to two branches (decoders) to generate an HR facial image with and without blur. In addition, local and global discriminators are combined to focus on the reconstruction of HR facial structures. Experiment results show that the proposed algorithm generates a realistic HR facial image. Furthermore, the proposed method can generate a variety of different facial images.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Face ReconstructionDeblurringFace RecognitionFace ReconstructionGenerative Adversarial NetworkImage ReconstructionImage Super-ResolutionSSIMSuper-ResolutionSimilar Papers 제목 키워드 기반
Joint Face Hallucination and Deblurring via Structure Generation and Detail Enhancement
We address the problem of restoring a high-resolution face image from a blurry low-resolution input. This problem is difficult as super-resolution and deblurring need to be tackled simultaneously. Moreover, existing algo…
DeblurringFace HallucinationHallucinationSuper-ResolutionJointly RS Image Deblurring and Super-Resolution with Adjustable-Kernel and Multi-Domain Attention
Remote Sensing (RS) image deblurring and Super-Resolution (SR) are common tasks in computer vision that aim at restoring RS image detail and spatial scale, respectively. However, real-world RS images often suffer from a …
DeblurringImage DeblurringSuper-ResolutionJoint Estimation of Camera Pose, Depth, Deblurring, and Super-Resolution from a Blurred Image Sequence
The conventional methods for estimating camera poses and scene structures from severely blurry or low resolution images often result in failure. The off-the-shelf deblurring or super-resolution methods may show visually …
Camera Pose EstimationDeblurringPose EstimationSuper-Resolution+1Learning to Super-Resolve Blurry Face and Text Images
We present an algorithm to directly restore a clear high-resolution image from a blurry low-resolution input. This problem is highly ill-posed and the basic assumptions for existing super-resolution methods (requiring cl…
DeblurringGenerative Adversarial NetworkImage RestorationSuper-ResolutionSDT-DCSCN for Simultaneous Super-Resolution and Deblurring of Text Images
Deep convolutional neural networks (Deep CNN) have achieved hopeful performance for single image super-resolution. In particular, the Deep CNN skip Connection and Network in Network (DCSCN) architecture has been successf…
DeblurringImage Super-ResolutionSuper-Resolution