paper-with-me

홈 › Papers

Look Through Masks: Towards Masked Face Recognition with De-Occlusion Distillation

2024-09-19 · Chenyu Li, Shiming Ge, Daichi Zhang, Jia Li

Many real-world applications today like video surveillance and urban governance need to address the recognition of masked faces, where content replacement by diverse masks often brings in incomplete appearance and ambiguous representation, leading to a sharp drop in accuracy. Inspired by recent progress on amodal perception, we propose to migrate the mechanism of amodal completion for the task of masked face recognition with an end-to-end de-occlusion distillation framework, which consists of two modules. The \textit{de-occlusion} module applies a generative adversarial network to perform face completion, which recovers the content under the mask and eliminates appearance ambiguity. The \textit{distillation} module takes a pre-trained general face recognition model as the teacher and transfers its knowledge to train a student for completed faces using massive online synthesized face pairs. Especially, the teacher knowledge is represented with structural relations among instances in multiple orders, which serves as a posterior regularization to enable the adaptation. In this way, the knowledge can be fully distilled and transferred to identify masked faces. Experiments on synthetic and realistic datasets show the efficacy of the proposed approach.

📄 PDF Abstract BibTeX arXiv:2409.12385

Code (0)

등록된 구현이 없습니다.

Tasks

Face RecognitionFacial InpaintingGenerative Adversarial Network

Similar Papers 제목 키워드 기반

Analysis of face detection, face landmarking, and face recognition performance with masked face images

2022-06-03 · Ožbej Golob

Face recognition has become an essential task in our lives. However, the current COVID-19 pandemic has led to the widespread use of face masks. The effect of wearing face masks is currently an understudied issue. The aim…

Face DetectionFace Recognition

Mask-invariant Face Recognition through Template-level Knowledge Distillation

2021-12-10 · Marco Huber, Fadi Boutros, Florian Kirchbuchner, Naser Damer

The emergence of the global COVID-19 pandemic poses new challenges for biometrics. Not only are contactless biometric identification options becoming more important, but face recognition has also recently been confronted…

Face RecognitionKnowledge Distillation

Masked Face Dataset Generation and Masked Face Recognition

2023-11-13 · Rui Cai, Xuying Ning, Peter N. Belhumeur

In the post-pandemic era, wearing face masks has posed great challenge to the ordinary face recognition. In the previous study, researchers has applied pretrained VGG16, and ResNet50 to extract features on the elaborate …

Data AugmentationDataset GenerationFace Recognition

Investigating the role of visual experience with face-masks in face recognition during COVID-19

2023-02-28 · Srijita Karmakar, Koel Das

The introduction of face masks during COVID-19 presents a potential challenge for human face perception and recognition. Face masks possibly hinder the holistic processing of faces leading to difficulty in facial recogni…

EEGElectroencephalogram (EEG)Face Recognition

A realistic approach to generate masked faces applied on two novel masked face recognition data sets

2021-09-03 · Tudor Mare, Georgian Duta, Mariana-Iuliana Georgescu, Adrian Sandru 외

The COVID-19 pandemic raises the problem of adapting face recognition systems to the new reality, where people may wear surgical masks to cover their noses and mouths. Traditional data sets (e.g., CelebA, CASIA-WebFace) …

Face Recognition