VarGFaceNet: An Efficient Variable Group Convolutional Neural Network for Lightweight Face Recognition
To improve the discriminative and generalization ability of lightweight network for face recognition, we propose an efficient variable group convolutional network called VarGFaceNet. Variable group convolution is introduced by VarGNet to solve the conflict between small computational cost and the unbalance of computational intensity inside a block. We employ variable group convolution to design our network which can support large scale face identification while reduce computational cost and parameters. Specifically, we use a head setting to reserve essential information at the start of the network and propose a particular embedding setting to reduce parameters of fully-connected layer for embedding. To enhance interpretation ability, we employ an equivalence of angular distillation loss to guide our lightweight network and we apply recursive knowledge distillation to relieve the discrepancy between the teacher model and the student model. The champion of deepglint-light track of LFR (2019) challenge demonstrates the effectiveness of our model and approach. Implementation of VarGFaceNet will be released at https://github.com/zma-c-137/VarGFaceNet soon.
Code (3)
Tasks
Face DetectionFace IdentificationFace RecognitionKnowledge DistillationLightweight Face RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
VarGNet: Variable Group Convolutional Neural Network for Efficient Embedded Computing
In this paper, we propose a novel network design mechanism for efficient embedded computing. Inspired by the limited computing patterns, we propose to fix the number of channels in a group convolution, instead of the exi…
Face RecognitionGhostFaceNets: Lightweight Face Recognition Model From Cheap Operations
The development of deep learning-based biometric models that can be deployed on devices with constrained memory and computational resources has proven to be a significant challenge. Previous approaches to this problem ha…
Face IdentificationFace RecognitionFace VerificationLightweight Face Recognition+1Pyramidal Dense Attention Networks for Lightweight Image Super-Resolution
Recently, deep convolutional neural network methods have achieved an excellent performance in image superresolution (SR), but they can not be easily applied to embedded devices due to large memory cost. To solve this pro…
Image Super-ResolutionSuper-ResolutionTraining Lightweight Graph Convolutional Networks with Phase-field Models
In this paper, we design lightweight graph convolutional networks (GCNs) using a particular class of regularizers, dubbed as phase-field models (PFMs). PFMs exhibit a bi-phase behavior using a particular ultra-local term…
SE3Kit: A Lightweight Python Library for Specialized Geometric Primitives in Robotics
The Python robotics ecosystem faces a challenge: while many libraries exist for rigid body transformations, few are both lightweight and mathematically strict. This paper introduces SE3Kit, a lightweight Python library e…