Pose-Robust Face Recognition via Deep Residual Equivariant Mapping
Face recognition achieves exceptional success thanks to the emergence of deep learning. However, many contemporary face recognition models still perform relatively poor in processing profile faces compared to frontal faces. A key reason is that the number of frontal and profile training faces are highly imbalanced - there are extensively more frontal training samples compared to profile ones. In addition, it is intrinsically hard to learn a deep representation that is geometrically invariant to large pose variations. In this study, we hypothesize that there is an inherent mapping between frontal and profile faces, and consequently, their discrepancy in the deep representation space can be bridged by an equivariant mapping. To exploit this mapping, we formulate a novel Deep Residual EquivAriant Mapping (DREAM) block, which is capable of adaptively adding residuals to the input deep representation to transform a profile face representation to a canonical pose that simplifies recognition. The DREAM block consistently enhances the performance of profile face recognition for many strong deep networks, including ResNet models, without deliberately augmenting training data of profile faces. The block is easy to use, light-weight, and can be implemented with a negligible computational overhead.
Code (1)
Tasks
Face IdentificationFace RecognitionFace VerificationRobust Face RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Cross-species Feature Learning for Animal Face Recognition via Residual Interspecies Equivariant Network
Although human face recognition has achieved exceptional success driven by deep learning, animal face recognition (AFR) is still a research field that received less attention. Due to the big challenge in collecting large…
Face AlignmentFace RecognitionCo-Attentive Equivariant Neural Networks: Focusing Equivariance On Transformations Co-Occurring In Data
Equivariance is a nice property to have as it produces much more parameter efficient neural architectures and preserves the structure of the input through the feature mapping. Even though some combinations of transformat…
Object RecognitionRotated MNISTEquivariant Finite Normalizing Flows
Generative modeling seeks to uncover the underlying factors that give rise to observed data that can often be modeled as the natural symmetries that manifest themselves through invariances and equivariances to certain tr…
Attention-guided Progressive Mapping for Profile Face Recognition
The past few years have witnessed great progress in the domain of face recognition thanks to advances in deep learning. However, cross pose face recognition remains a significant challenge. It is difficult for many deep …
Face RecognitionNaturally Computed Scale Invariance in the Residual Stream of ResNet18
An important capacity in visual object recognition is invariance to image-altering variables which leave the identity of objects unchanged, such as lighting, rotation, and scale. How do neural networks achieve this? Prio…
Object Recognition