CooGAN: A Memory-Efficient Framework for High-Resolution Facial Attribute Editing
In contrast to great success of memory-consuming face editing methods at a low resolution, to manipulate high-resolution (HR) facial images, i.e., typically larger than 7682 pixels, with very limited memory is still challenging. This is due to the reasons of 1) intractable huge demand of memory; 2) inefficient multi-scale features fusion. To address these issues, we propose a NOVEL pixel translation framework called Cooperative GAN(CooGAN) for HR facial image editing. This framework features a local path for fine-grained local facial patch generation (i.e., patch-level HR, LOW memory) and a global path for global lowresolution (LR) facial structure monitoring (i.e., image-level LR, LOW memory), which largely reduce memory requirements. Both paths work in a cooperative manner under a local-to-global consistency objective (i.e., for smooth stitching). In addition, we propose a lighter selective transfer unit for more efficient multi-scale features fusion, yielding higher fidelity facial attributes manipulation. Extensive experiments on CelebAHQ well demonstrate the memory efficiency as well as the high image generation quality of the proposed framework.
Code (1)
Tasks
AttributeImage GenerationTranslationVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Attention-Driven Cropping for Very High Resolution Facial Landmark Detection
Facial landmark detection is a fundamental task for many consumer and high-end applications and is almost entirely solved by machine learning methods today. Existing datasets used to train such algorithms are primarily m…
4kFacial Landmark DetectionVocal Bursts Intensity PredictionLow-resolution Face Recognition in the Wild via Selective Knowledge Distillation
Typically, the deployment of face recognition models in the wild needs to identify low-resolution faces with extremely low computational cost. To address this problem, a feasible solution is compressing a complex face mo…
CPUFace ModelFace RecognitionGPU+1FacEnhance: Facial Expression Enhancing with Recurrent DDPMs
Facial expressions, vital in non-verbal human communication, have found applications in various computer vision fields like virtual reality, gaming, and emotional AI assistants. Despite advancements, many facial expressi…
Computational EfficiencyDenoisingFacial expression generationJoint Face Super-Resolution and Deblurring Using a Generative Adversarial Network
Facial image super-resolution (SR) is an important preprocessing for facial image analysis, face recognition, and image-based 3D face reconstruction. Recent convolutional neural network (CNN) based method has shown excel…
3D Face ReconstructionDeblurringFace RecognitionFace Reconstruction+5Dynamic Resolution Guidance for Facial Expression Recognition
Facial expression recognition (FER) is vital for human-computer interaction and emotion analysis, yet recognizing expressions in low-resolution images remains challenging. This paper introduces a practical method called …
Emotion RecognitionFacial Expression RecognitionFacial Expression Recognition (FER)