paper-with-me

홈 › Papers

Virtual Fully-Connected Layer: Training a Large-Scale Face Recognition Dataset With Limited Computational Resources

2021-06-19 · CVPR 2021 1 · Pengyu Li, Biao Wang, Lei Zhang

Recently, deep face recognition has achieved significant progress because of Convolutional Neural Networks (CNNs) and large-scale datasets. However, training CNNs on a large-scale face recognition dataset with limited computational resources is still a challenge. This is because the classification paradigm needs to train a fully connected layer as the category classifier, and its parameters will be in the hundreds of millions if the training dataset contains millions of identities. This requires many computational resources, such as GPU memory. The metric learning paradigm is an economical computation method, but its performance is greatly inferior to that of the classification paradigm. To address this challenge, we propose a simple but effective CNN layer called the Virtual fully connected (Virtual FC) layer to reduce the computational consumption of the classification paradigm. Without bells and whistles, the proposed Virtual FC reduces the parameters by more than 100 times with respect to the fully connected layer and achieves competitive performance on mainstream face recognition evaluation datasets. Moreover, the performance of our Virtual FC layer on the evaluation datasets is superior to that of the metric learning paradigm by a significant margin. Our code will be released in hopes of disseminating our idea to other domains.

📄 PDF Abstract BibTeX

Code (1)

pengyuLPY/Virtual-Fully-Connected-Layer 공식 구현 pytorch

Tasks

Face RecognitionGPUMetric Learning

Similar Papers 제목 키워드 기반

Do We Need Fully Connected Output Layers in Convolutional Networks?

2020-04-28 · Zhongchao Qian, Tyler L. Hayes, Kushal Kafle, Christopher Kanan

Traditionally, deep convolutional neural networks consist of a series of convolutional and pooling layers followed by one or more fully connected (FC) layers to perform the final classification. While this design has bee…

General Classification

Virtual CNN Branching: Efficient Feature Ensemble for Person Re-Identification

2018-03-15 · Albert Gong, Qiang Qiu, Guillermo Sapiro

In this paper we introduce an ensemble method for convolutional neural network (CNN), called "virtual branching," which can be implemented with nearly no additional parameters and computation on top of standard CNNs. We …

Person Re-Identification

Towards Lightweight Neural Animation : Exploration of Neural Network Pruning in Mixture of Experts-based Animation Models

2022-01-11 · Antoine Maiorca, Nathan Hubens, Sohaib Laraba, Thierry Dutoit

In the past few years, neural character animation has emerged and offered an automatic method for animating virtual characters. Their motion is synthesized by a neural network. Controlling this movement in real time with…

Mixture-of-ExpertsNetwork Pruning

SensLI: Sensitivity-Based Layer Insertion for Neural Networks

2023-11-27 · Leonie Kreis, Evelyn Herberg, Frederik Köhne, Anton Schiela 외

The training of neural networks requires tedious and often manual tuning of the network architecture. We propose a systematic approach to inserting new layers during the training process. Our method eliminates the need t…

Sensitivity

AttFC: Attention Fully-Connected Layer for Large-Scale Face Recognition with One GPU

2025-03-10 · Zhuowen Zheng, Yain-Whar Si, Xiaochen Yuan, Junwei Duan 외

Nowadays, with the advancement of deep neural networks (DNNs) and the availability of large-scale datasets, the face recognition (FR) model has achieved exceptional performance. However, since the parameter magnitude of …

Face RecognitionGPU