EFHQ: Multi-purpose ExtremePose-Face-HQ dataset
The existing facial datasets, while having plentiful images at near frontal views, lack images with extreme head poses, leading to the downgraded performance of deep learning models when dealing with profile or pitched faces. This work aims to address this gap by introducing a novel dataset named Extreme Pose Face High-Quality Dataset (EFHQ), which includes a maximum of 450k high-quality images of faces at extreme poses. To produce such a massive dataset, we utilize a novel and meticulous dataset processing pipeline to curate two publicly available datasets, VFHQ and CelebV-HQ, which contain many high-resolution face videos captured in various settings. Our dataset can complement existing datasets on various facial-related tasks, such as facial synthesis with 2D/3D-aware GAN, diffusion-based text-to-image face generation, and face reenactment. Specifically, training with EFHQ helps models generalize well across diverse poses, significantly improving performance in scenarios involving extreme views, confirmed by extensive experiments. Additionally, we utilize EFHQ to define a challenging cross-view face verification benchmark, in which the performance of SOTA face recognition models drops 5-37% compared to frontal-to-frontal scenarios, aiming to stimulate studies on face recognition under severe pose conditions in the wild.
Code (0)
등록된 구현이 없습니다.
Tasks
Face GenerationFace RecognitionFace ReenactmentFace VerificationSimilar Papers 제목 키워드 기반
PrivacyNet: Semi-Adversarial Networks for Multi-attribute Face Privacy
Recent research has established the possibility of deducing soft-biometric attributes such as age, gender and race from an individual's face image with high accuracy. However, this raises privacy concerns, especially whe…
AttributeIllumination-invariant Face recognition by fusing thermal and visual images via gradient transfer
Face recognition in real life situations like low illumination condition is still an open challenge in biometric security. It is well established that the state-of-the-art methods in face recognition provide low accuracy…
Face DetectionFace RecognitionPhotorealistic Novel View Synthesis of Human Faces using Next-Scale Transformers
Photorealistic novel view synthesis of people remains challenging at high spatial resolutions and across multiple target cameras, where preserving identity, fine appearance details, and geometric coherence is critical. W…
Novel View SynthesisFDDB-360: Face Detection in 360-degree Fisheye Images
360-degree cameras offer the possibility to cover a large area, for example an entire room, without using multiple distributed vision sensors. However, geometric distortions introduced by their lenses make computer visio…
Face DetectionBringing Structure into Summaries: a Faceted Summarization Dataset for Long Scientific Documents
Faceted summarization provides briefings of a document from different perspectives. Readers can quickly comprehend the main points of a long document with the help of a structured outline. However, little research has be…
ArticlesUnsupervised Extractive Summarization