paper-with-me

홈 › Papers

AMC-Loss: Angular Margin Contrastive Loss for Improved Explainability in Image Classification

2020-04-21 · Hongjun Choi, Anirudh Som, Pavan Turaga

Deep-learning architectures for classification problems involve the cross-entropy loss sometimes assisted with auxiliary loss functions like center loss, contrastive loss and triplet loss. These auxiliary loss functions facilitate better discrimination between the different classes of interest. However, recent studies hint at the fact that these loss functions do not take into account the intrinsic angular distribution exhibited by the low-level and high-level feature representations. This results in less compactness between samples from the same class and unclear boundary separations between data clusters of different classes. In this paper, we address this issue by proposing the use of geometric constraints, rooted in Riemannian geometry. Specifically, we propose Angular Margin Contrastive Loss (AMC-Loss), a new loss function to be used along with the traditional cross-entropy loss. The AMC-Loss employs the discriminative angular distance metric that is equivalent to geodesic distance on a hypersphere manifold such that it can serve a clear geometric interpretation. We demonstrate the effectiveness of AMC-Loss by providing quantitative and qualitative results. We find that although the proposed geometrically constrained loss-function improves quantitative results modestly, it has a qualitatively surprisingly beneficial effect on increasing the interpretability of deep-net decisions as seen by the visual explanations generated by techniques such as the Grad-CAM. Our code is available at https://github.com/hchoi71/AMC-Loss.

📄 PDF Abstract BibTeX arXiv:2004.09805

Code (1)

hchoi71/AMC-Loss 공식 구현 tf

Tasks

General Classificationimage-classificationImage ClassificationTriplet

Methods 이 논문이 사용한 방법론

Interpretability 설명 없음

Similar Papers 제목 키워드 기반

Self-supervised learning of audio representations using angular contrastive loss

2022-11-10 · Shanshan Wang, Soumya Tripathy, Annamaria Mesaros

In Self-Supervised Learning (SSL), various pretext tasks are designed for learning feature representations through contrastive loss. However, previous studies have shown that this loss is less tolerant to semantically si…

Contrastive LearningSelf-Supervised Learning

Discriminative Speaker Representation via Contrastive Learning with Class-Aware Attention in Angular Space

2022-10-29 · Zhe Li, Man-Wai Mak, Helen Mei-Ling Meng

The challenges in applying contrastive learning to speaker verification (SV) are that the softmax-based contrastive loss lacks discriminative power and that the hard negative pairs can easily influence learning. To overc…

Contrastive LearningSpeaker Verification

A Comparison of Metric Learning Loss Functions for End-To-End Speaker Verification

2020-03-31 · Juan M. Coria, Hervé Bredin, Sahar Ghannay, Sophie Rosset

Despite the growing popularity of metric learning approaches, very little work has attempted to perform a fair comparison of these techniques for speaker verification. We try to fill this gap and compare several metric l…

Metric LearningSpeaker VerificationTriplet

Adaptive Margin Circle Loss for Speaker Verification

2021-06-15 · Runqiu Xiao

Deep-Neural-Network (DNN) based speaker verification sys-tems use the angular softmax loss with margin penalties toenhance the intra-class compactness of speaker embeddings,which achieved remarkable performance. In this …

Speaker Verification

Experimenting with Additive Margins for Contrastive Self-Supervised Speaker Verification

2023-06-06 · Theo Lepage, Reda Dehak

Most state-of-the-art self-supervised speaker verification systems rely on a contrastive-based objective function to learn speaker representations from unlabeled speech data. We explore different ways to improve the perf…

Speaker Verification