paper-with-me

Papers

Frequency Aware Face Hallucination Generative Adversarial Network with Semantic Structural Constraint

2021-10-05 · Shailza Sharma, Abhinav Dhall, Vinay Kumar

In this paper, we address the issue of face hallucination. Most current face hallucination methods rely on two-dimensional facial priors to generate high resolution face images from low resolution face images. These methods are only capable of assimilating global information into the generated image. Still there exist some inherent problems in these methods; such as, local features, subtle structural details and missing depth information in final output image. Present work proposes a Generative Adversarial Network (GAN) based novel progressive Face Hallucination (FH) network to address these issues present among current methods. The generator of the proposed model comprises of FH network and two sub-networks, assisting FH network to generate high resolution images. The first sub-network leverages on explicitly adding high frequency components into the model. To explicitly encode the high frequency components, an auto encoder is proposed to generate high resolution coefficients of Discrete Cosine Transform (DCT). To add three dimensional parametric information into the network, second sub-network is proposed. This network uses a shape model of 3D Morphable Models (3DMM) to add structural constraint to the FH network. Extensive experimentation results in the paper shows that the proposed model outperforms the state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2110.01880

Code (0)

등록된 구현이 없습니다.

Tasks

Face HallucinationGenerative Adversarial NetworkHallucination

Methods 이 논문이 사용한 방법론

Discrete Cosine Transform Discrete Cosine Transform (DCT) is an orthogonal transformation method that decomposes an image to its spatial frequency spectrum. It expresses a finite sequence of data…

Similar Papers 제목 키워드 기반

Audio-visual video face hallucination with frequency supervision and cross modality support by speech based lip reading loss

2022-11-20 · Shailza Sharma, Abhinav Dhall, Vinay Kumar, Vivek Singh Bawa

Recently, there has been numerous breakthroughs in face hallucination tasks. However, the task remains rather challenging in videos in comparison to the images due to inherent consistency issues. The presence of extra te…

Face HallucinationGenerative Adversarial NetworkHallucinationLip Reading

Identity-Aware Deep Face Hallucination via Adversarial Face Verification

2019-09-17 · Hadi Kazemi, Fariborz Taherkhani, Nasser M. Nasrabadi

In this paper, we address the problem of face hallucination by proposing a novel multi-scale generative adversarial network (GAN) architecture optimized for face verification. First, we propose a multi-scale generator ar…

Face HallucinationFace VerificationGenerative Adversarial NetworkHallucination

FH-GAN: Face Hallucination and Recognition using Generative Adversarial Network

2019-05-16 · Bayram Bayramli, Usman Ali, Te Qi, Hongtao Lu

There are many factors affecting visual face recognition, such as low resolution images, aging, illumination and pose variance, etc. One of the most important problem is low resolution face images which can result in bad…

Face HallucinationFace RecognitionGenerative Adversarial NetworkHallucination

Towards Controllable and Interpretable Face Completion via Structure-Aware and Frequency-Oriented Attentive GANs

2019-09-25 · Zeyuan Chen, Shaoliang Nie, Tianfu Wu, Christopher G. Healey

Face completion is a challenging conditional image synthesis task. This paper proposes controllable and interpretable high-resolution and fast face completion by learning generative adversarial networks (GANs) progressiv…

Facial InpaintingGPUImage Generation

Frequency-aware Interface Dynamics with Generative Adversarial Networks

2021-01-01 · Lukas Prantl, Tassilo Kugelstadt, Jan Bender, Nils Thuerey

We present a new method for reconstructing and refining complex surfaces based on physical simulations. Taking a roughly approximated simulation as input, our method infers corresponding spatial details while taking int…

Physical Simulations