paper-with-me

Papers

Efficient Low-Resolution Face Recognition via Bridge Distillation

2024-09-18 · Shiming Ge, Shengwei Zhao, Chenyu Li, Yu Zhang, Jia Li

Face recognition in the wild is now advancing towards light-weight models, fast inference speed and resolution-adapted capability. In this paper, we propose a bridge distillation approach to turn a complex face model pretrained on private high-resolution faces into a light-weight one for low-resolution face recognition. In our approach, such a cross-dataset resolution-adapted knowledge transfer problem is solved via two-step distillation. In the first step, we conduct cross-dataset distillation to transfer the prior knowledge from private high-resolution faces to public high-resolution faces and generate compact and discriminative features. In the second step, the resolution-adapted distillation is conducted to further transfer the prior knowledge to synthetic low-resolution faces via multi-task learning. By learning low-resolution face representations and mimicking the adapted high-resolution knowledge, a light-weight student model can be constructed with high efficiency and promising accuracy in recognizing low-resolution faces. Experimental results show that the student model performs impressively in recognizing low-resolution faces with only 0.21M parameters and 0.057MB memory. Meanwhile, its speed reaches up to 14,705, ~934 and 763 faces per second on GPU, CPU and mobile phone, respectively.

📄 PDF Abstract BibTeX arXiv:2409.11786

Code (0)

등록된 구현이 없습니다.

Tasks

CPUDataset DistillationFace ModelFace RecognitionGPUMulti-Task LearningTransfer Learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Distilling Generative-Discriminative Representations for Very Low-Resolution Face Recognition

2024-09-10 · Junzheng Zhang, Weijia Guo, Bochao Liu, Ruixin Shi 외

Very low-resolution face recognition is challenging due to the serious loss of informative facial details in resolution degradation. In this paper, we propose a generative-discriminative representation distillation appro…

Face RecognitionKnowledge DistillationSuper-ResolutionTransfer Learning

Low-Resolution Face Recognition via Adaptable Instance-Relation Distillation

2024-09-03 · Ruixin Shi, Weijia Guo, Shiming Ge

Low-resolution face recognition is a challenging task due to the missing of informative details. Recent approaches based on knowledge distillation have proven that high-resolution clues can well guide low-resolution face…

Face RecognitionKnowledge DistillationRelationTransfer Learning

Low-Resolution Object Recognition with Cross-Resolution Relational Contrastive Distillation

2024-09-04 · Kangkai Zhang, Shiming Ge, Ruixin Shi, Dan Zeng

Recognizing objects in low-resolution images is a challenging task due to the lack of informative details. Recent studies have shown that knowledge distillation approaches can effectively transfer knowledge from a high-r…

Face RecognitionKnowledge DistillationObject RecognitionTransfer Learning

Teaching Where to Look: Attention Similarity Knowledge Distillation for Low Resolution Face Recognition

2022-09-29 · Sungho Shin, Joosoon Lee, Junseok Lee, Yeonguk Yu 외

Deep learning has achieved outstanding performance for face recognition benchmarks, but performance reduces significantly for low resolution (LR) images. We propose an attention similarity knowledge distillation approach…

Face RecognitionKnowledge Distillation

Cross-Resolution Face Recognition via Prior-Aided Face Hallucination and Residual Knowledge Distillation

2019-05-26 · Hanyang Kong, Jian Zhao, Xiaoguang Tu, Junliang Xing 외

Recent deep learning based face recognition methods have achieved great performance, but it still remains challenging to recognize very low-resolution query face like 28x28 pixels when CCTV camera is far from the capture…

Face HallucinationFace RecognitionGenerative Adversarial NetworkHallucination+2