Controllable and Guided Face Synthesis for Unconstrained Face Recognition
Although significant advances have been made in face recognition (FR), FR in unconstrained environments remains challenging due to the domain gap between the semi-constrained training datasets and unconstrained testing scenarios. To address this problem, we propose a controllable face synthesis model (CFSM) that can mimic the distribution of target datasets in a style latent space. CFSM learns a linear subspace with orthogonal bases in the style latent space with precise control over the diversity and degree of synthesis. Furthermore, the pre-trained synthesis model can be guided by the FR model, making the resulting images more beneficial for FR model training. Besides, target dataset distributions are characterized by the learned orthogonal bases, which can be utilized to measure the distributional similarity among face datasets. Our approach yields significant performance gains on unconstrained benchmarks, such as IJB-B, IJB-C, TinyFace and IJB-S (+5.76% Rank1).
Code (3)
Tasks
DiversityFace GenerationFace RecognitionFace VerificationSimilar Papers 제목 키워드 기반
Geometry Guided Adversarial Facial Expression Synthesis
Facial expression synthesis has drawn much attention in the field of computer graphics and pattern recognition. It has been widely used in face animation and recognition. However, it is still challenging due to the high-…
Face RecognitionFace TransferGenerative Adversarial NetworkTexture SynthesisA recurrent cycle consistency loss for progressive face-to-face synthesis
This paper addresses a major flaw of the cycle consistency loss when used to preserve the input appearance in the face-to-face synthesis domain. In particular, we show that the images generated by a network trained using…
Face GenerationUnconstrained Face Sketch Synthesis via Perception-Adaptive Network and A New Benchmark
Face sketch generation has attracted much attention in the field of visual computing. However, existing methods either are limited to constrained conditions or heavily rely on various preprocessing steps to deal with in-…
DecoderFace Sketch SynthesisRepresentation LearningFastAvatar: Instant 3D Gaussian Splatting for Faces from Single Unconstrained Poses
We present FastAvatar, a fast and robust algorithm for single-image 3D face reconstruction using 3D Gaussian Splatting (3DGS). Given a single input image from an arbitrary pose, FastAvatar recovers a high-quality, full-h…
3D Face ReconstructionCGOF++: Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields
Capitalizing on the recent advances in image generation models, existing controllable face image synthesis methods are able to generate high-fidelity images with some levels of controllability, e.g., controlling the shap…
Face GenerationImage GenerationNeRF