Look Through Masks: Towards Masked Face Recognition with De-Occlusion Distillation
Many real-world applications today like video surveillance and urban governance need to address the recognition of masked faces, where content replacement by diverse masks often brings in incomplete appearance and ambiguous representation, leading to a sharp drop in accuracy. Inspired by recent progress on amodal perception, we propose to migrate the mechanism of amodal completion for the task of masked face recognition with an end-to-end de-occlusion distillation framework, which consists of two modules. The \textit{de-occlusion} module applies a generative adversarial network to perform face completion, which recovers the content under the mask and eliminates appearance ambiguity. The \textit{distillation} module takes a pre-trained general face recognition model as the teacher and transfers its knowledge to train a student for completed faces using massive online synthesized face pairs. Especially, the teacher knowledge is represented with structural relations among instances in multiple orders, which serves as a posterior regularization to enable the adaptation. In this way, the knowledge can be fully distilled and transferred to identify masked faces. Experiments on synthetic and realistic datasets show the efficacy of the proposed approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Face RecognitionFacial InpaintingGenerative Adversarial NetworkSimilar Papers 제목 키워드 기반
Analysis of face detection, face landmarking, and face recognition performance with masked face images
Face recognition has become an essential task in our lives. However, the current COVID-19 pandemic has led to the widespread use of face masks. The effect of wearing face masks is currently an understudied issue. The aim…
Face DetectionFace RecognitionMask-invariant Face Recognition through Template-level Knowledge Distillation
The emergence of the global COVID-19 pandemic poses new challenges for biometrics. Not only are contactless biometric identification options becoming more important, but face recognition has also recently been confronted…
Face RecognitionKnowledge DistillationMasked Face Dataset Generation and Masked Face Recognition
In the post-pandemic era, wearing face masks has posed great challenge to the ordinary face recognition. In the previous study, researchers has applied pretrained VGG16, and ResNet50 to extract features on the elaborate …
Data AugmentationDataset GenerationFace RecognitionInvestigating the role of visual experience with face-masks in face recognition during COVID-19
The introduction of face masks during COVID-19 presents a potential challenge for human face perception and recognition. Face masks possibly hinder the holistic processing of faces leading to difficulty in facial recogni…
EEGElectroencephalogram (EEG)Face RecognitionA realistic approach to generate masked faces applied on two novel masked face recognition data sets
The COVID-19 pandemic raises the problem of adapting face recognition systems to the new reality, where people may wear surgical masks to cover their noses and mouths. Traditional data sets (e.g., CelebA, CASIA-WebFace) …
Face Recognition