Set-Based Face Recognition Beyond Disentanglement: Burstiness Suppression With Variance Vocabulary
Set-based face recognition (SFR) aims to recognize the face sets in the unconstrained scenario, where the appearance of same identity may change dramatically with extreme variances (e.g., illumination, pose, expression). We argue that the two crucial issues in SFR, the face quality and burstiness, are both identity-irrelevant and variance-relevant. The quality and burstiness assessment are interfered with by the entanglement of identity, and the face recognition is interfered with by the entanglement of variance. Thus we propose to separate the identity features with the variance features in a light-weighted set-based disentanglement framework. Beyond disentanglement, the variance features are fully utilized to indicate face quality and burstiness in a set, rather than being discarded after training. To suppress face burstiness in the sets, we propose a vocabulary-based burst suppression (VBS) method which quantizes faces with a reference vocabulary. With interword and intra-word normalization operations on the assignment scores, the face burtisness degrees are appropriately estimated. The extensive illustrations and experiments demonstrate the effect of the disentanglement framework with VBS, which gets new state-of-the-art on the SFR benchmarks. The code will be released at https://github.com/Liubinggunzu/set_burstiness.
Code (0)
등록된 구현이 없습니다.
Tasks
DisentanglementFace RecognitionSimilar Papers 제목 키워드 기반
On the Burstiness of Faces in Set
Burstiness, a phenomenon observed in text and image retrieval, refers to that particular elements appear more times in a set than a statistically independent model assumes. We argue that in the context of set-based face …
Face RecognitionImage RetrievalGAN-based disentanglement learning for chest X-ray rib suppression
Clinical evidence has shown that rib-suppressed chest X-rays (CXRs) can improve the reliability of pulmonary disease diagnosis. However, previous approaches on generating rib-suppressed CXR face challenges in preserving …
BenchmarkingComputed Tomography (CT)DisentanglementLung Disease ClassificationHigh-order Tensor Pooling with Attention for Action Recognition
We aim at capturing high-order statistics of feature vectors formed by a neural network, and propose end-to-end second- and higher-order pooling to form a tensor descriptor. Tensor descriptors require a robust similarity…
Action RecognitionScene RecognitionVocal Bursts Intensity PredictionDisentangled Representation for Age-Invariant Face Recognition: A Mutual Information Minimization Perspective
General face recognition has seen remarkable progress in recent years. However, large age gap still remains a big challenge due to significant alterations in facial appearance and bone structure. Disentanglement play…
Age-Invariant Face RecognitionDisentanglementFace RecognitionMORPH+2PASS: Protected Attribute Suppression System for Mitigating Bias in Face Recognition
Face recognition networks encode information about sensitive attributes while being trained for identity classification. Such encoding has two major issues: (a) it makes the face representations susceptible to privacy le…
AttributeFace Recognition