paper-with-me

Papers

Large-Margin Softmax Loss for Convolutional Neural Networks

2016-12-07 · Weiyang Liu, Yandong Wen, Zhiding Yu, Meng Yang

Cross-entropy loss together with softmax is arguably one of the most common used supervision components in convolutional neural networks (CNNs). Despite its simplicity, popularity and excellent performance, the component does not explicitly encourage discriminative learning of features. In this paper, we propose a generalized large-margin softmax (L-Softmax) loss which explicitly encourages intra-class compactness and inter-class separability between learned features. Moreover, L-Softmax not only can adjust the desired margin but also can avoid overfitting. We also show that the L-Softmax loss can be optimized by typical stochastic gradient descent. Extensive experiments on four benchmark datasets demonstrate that the deeply-learned features with L-softmax loss become more discriminative, hence significantly boosting the performance on a variety of visual classification and verification tasks.

📄 PDF Abstract BibTeX arXiv:1612.02295

Code (2)

wy1iu/LargeMargin_Softmax_Loss 공식 구현 pytorch
amirhfarzaneh/lsoftmax-pytorch pytorch

Tasks

General Classification

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

CosFace: Large Margin Cosine Loss for Deep Face Recognition

2018-01-29 · CVPR 2018 6 · Hao Wang, Yitong Wang, Zheng Zhou, Xing Ji 외

Face recognition has made extraordinary progress owing to the advancement of deep convolutional neural networks (CNNs). The central task of face recognition, including face verification and identification, involves face …

Face IdentificationFace RecognitionFace Verification

Enlarged Large Margin Loss for Imbalanced Classification

2023-06-15 · Sota Kato, Kazuhiro Hotta

We propose a novel loss function for imbalanced classification. LDAM loss, which minimizes a margin-based generalization bound, is widely utilized for class-imbalanced image classification. Although, by using LDAM loss, …

Classificationimage-classificationImage Classificationimbalanced classification

Additive Margin Softmax for Face Verification

2018-01-17 · Feng Wang, Weiyang Liu, Haijun Liu, Jian Cheng

In this paper, we propose a conceptually simple and geometrically interpretable objective function, i.e. additive margin Softmax (AM-Softmax), for deep face verification. In general, the face verification task can be vie…

Face VerificationMetric Learning

Support Vector Guided Softmax Loss for Face Recognition

2018-12-29 · Xiaobo Wang, Shuo Wang, Shifeng Zhang, Tianyu Fu 외

Face recognition has witnessed significant progresses due to the advances of deep convolutional neural networks (CNNs), the central challenge of which, is feature discrimination. To address it, one group tries to exploit…

Face Recognition

Real Additive Margin Softmax for Speaker Verification

2021-10-18 · Lantian Li, Ruiqian Nai, Dong Wang

The additive margin softmax (AM-Softmax) loss has delivered remarkable performance in speaker verification. A supposed behavior of AM-Softmax is that it can shrink within-class variation by putting emphasis on target log…

Speaker Verification