Triplet Distillation for Deep Face Recognition
Convolutional neural networks (CNNs) have achieved a great success in face recognition, which unfortunately comes at the cost of massive computation and storage consumption. Many compact face recognition networks are thus proposed to resolve this problem. Triplet loss is effective to further improve the performance of those compact models. However, it normally employs a fixed margin to all the samples, which neglects the informative similarity structures between different identities. In this paper, we propose an enhanced version of triplet loss, named triplet distillation, which exploits the capability of a teacher model to transfer the similarity information to a small model by adaptively varying the margin between positive and negative pairs. Experiments on LFW, AgeDB, and CPLFW datasets show the merits of our method compared to the original triplet loss.
Code (1)
Tasks
Face RecognitionTripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Teacher-Student Training and Triplet Loss to Reduce the Effect of Drastic Face Occlusion
We study a series of recognition tasks in two realistic scenarios requiring the analysis of faces under strong occlusion. On the one hand, we aim to recognize facial expressions of people wearing Virtual Reality (VR) hea…
Age EstimationFacial Expression RecognitionFacial Expression Recognition (FER)Knowledge Distillation+1Teacher-Student Training and Triplet Loss for Facial Expression Recognition under Occlusion
In this paper, we study the task of facial expression recognition under strong occlusion. We are particularly interested in cases where 50% of the face is occluded, e.g. when the subject wears a Virtual Reality (VR) head…
Facial Expression RecognitionFacial Expression Recognition (FER)Knowledge DistillationTripletTriplet Knowledge Distillation
In Knowledge Distillation, the teacher is generally much larger than the student, making the solution of the teacher likely to be difficult for the student to learn. To ease the mimicking difficulty, we introduce a tripl…
Face Recognitionimage-classificationImage ClassificationKnowledge Distillation+1MassFace: an efficient implementation using triplet loss for face recognition
In this paper we present an efficient implementation using triplet loss for face recognition. We conduct the practical experiment to analyze the factors that influence the training of triplet loss. All models are trained…
Face RecognitionTripletGenCNER: A Generative Framework for Continual Named Entity Recognition
Traditional named entity recognition (NER) aims to identify text mentions into pre-defined entity types. Continual Named Entity Recognition (CNER) is introduced since entity categories are continuously increasing in vari…
Knowledge DistillationContinual Learning