Occlusion Robust Face Recognition Based on Mask Learning with PairwiseDifferential Siamese Network
Deep Convolutional Neural Networks (CNNs) have been pushing the frontier of the face recognition research in the past years. However, existing general CNN face models generalize poorly to the scenario of occlusions on variable facial areas. Inspired by the fact that a human visual system explicitly ignores occlusions and only focuses on non-occluded facial areas, we propose a mask learning strategy to find and discard the corrupted feature elements for face recognition. A mask dictionary is firstly established by exploiting the differences between the top convoluted features of occluded and occlusion-free face pairs using an innovatively designed Pairwise Differential Siamese Network (PDSN). Each item of this dictionary captures the correspondence between occluded facial areas and corrupted feature elements, which is named Feature Discarding Mask (FDM). When dealing with a face image with random partial occlusions, we generate its FDM by combining relevant dictionary items and then multiply it with the original features to eliminate those corrupted feature elements. Comprehensive experiments on both synthesized and realistic occluded face datasets show that the proposed approach significantly outperforms the state-of-the-arts.
Code (1)
Tasks
Face RecognitionRobust Face RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Occlusion Robust Face Recognition Based on Mask Learning With Pairwise Differential Siamese Network
Deep Convolutional Neural Networks (CNNs) have been pushing the frontier of face recognition over past years. However, existing CNN models are far less accurate when handling partially occluded faces. These general face…
Face RecognitionRobust Face RecognitionTowards NIR-VIS Masked Face Recognition
Near-infrared to visible (NIR-VIS) face recognition is the most common case in heterogeneous face recognition, which aims to match a pair of face images captured from two different modalities. Existing deep learning base…
3D Face ReconstructionFace RecognitionFace ReconstructionHeterogeneous Face RecognitionUnderstanding Masked Image Modeling via Learning Occlusion Invariant Feature
Recently, Masked Image Modeling (MIM) achieves great success in self-supervised visual recognition. However, as a reconstruction-based framework, it is still an open question to understand how MIM works, since MIM appear…
Contrastive LearningOpen-Ended Question AnsweringA Comprehensive Study on Occlusion Invariant Face Recognition under Face Mask Occlusion
The face mask is an essential sanitaryware in daily lives growing during the pandemic period and is a big threat to current face recognition systems. The masks destroy a lot of details in a large area of face, and it mak…
Face RecognitionWhen Face Recognition Meets Occlusion: A New Benchmark
The existing face recognition datasets usually lack occlusion samples, which hinders the development of face recognition. Especially during the COVID-19 coronavirus epidemic, wearing a mask has become an effective means …
DiversityFace Recognition