Efficient Low-Resolution Face Recognition via Bridge Distillation
Face recognition in the wild is now advancing towards light-weight models, fast inference speed and resolution-adapted capability. In this paper, we propose a bridge distillation approach to turn a complex face model pretrained on private high-resolution faces into a light-weight one for low-resolution face recognition. In our approach, such a cross-dataset resolution-adapted knowledge transfer problem is solved via two-step distillation. In the first step, we conduct cross-dataset distillation to transfer the prior knowledge from private high-resolution faces to public high-resolution faces and generate compact and discriminative features. In the second step, the resolution-adapted distillation is conducted to further transfer the prior knowledge to synthetic low-resolution faces via multi-task learning. By learning low-resolution face representations and mimicking the adapted high-resolution knowledge, a light-weight student model can be constructed with high efficiency and promising accuracy in recognizing low-resolution faces. Experimental results show that the student model performs impressively in recognizing low-resolution faces with only 0.21M parameters and 0.057MB memory. Meanwhile, its speed reaches up to 14,705, ~934 and 763 faces per second on GPU, CPU and mobile phone, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
CPUDataset DistillationFace ModelFace RecognitionGPUMulti-Task LearningTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Distilling Generative-Discriminative Representations for Very Low-Resolution Face Recognition
Very low-resolution face recognition is challenging due to the serious loss of informative facial details in resolution degradation. In this paper, we propose a generative-discriminative representation distillation appro…
Face RecognitionKnowledge DistillationSuper-ResolutionTransfer LearningLow-Resolution Face Recognition via Adaptable Instance-Relation Distillation
Low-resolution face recognition is a challenging task due to the missing of informative details. Recent approaches based on knowledge distillation have proven that high-resolution clues can well guide low-resolution face…
Face RecognitionKnowledge DistillationRelationTransfer LearningLow-Resolution Object Recognition with Cross-Resolution Relational Contrastive Distillation
Recognizing objects in low-resolution images is a challenging task due to the lack of informative details. Recent studies have shown that knowledge distillation approaches can effectively transfer knowledge from a high-r…
Face RecognitionKnowledge DistillationObject RecognitionTransfer LearningTeaching Where to Look: Attention Similarity Knowledge Distillation for Low Resolution Face Recognition
Deep learning has achieved outstanding performance for face recognition benchmarks, but performance reduces significantly for low resolution (LR) images. We propose an attention similarity knowledge distillation approach…
Face RecognitionKnowledge DistillationCross-Resolution Face Recognition via Prior-Aided Face Hallucination and Residual Knowledge Distillation
Recent deep learning based face recognition methods have achieved great performance, but it still remains challenging to recognize very low-resolution query face like 28x28 pixels when CCTV camera is far from the capture…
Face HallucinationFace RecognitionGenerative Adversarial NetworkHallucination+2