paper-with-me

홈 › Papers

Exploiting Class Activation Value for Partial-Label Learning

2021-09-29 · ICLR 2022 4 · Fei Zhang, Lei Feng, Bo Han, Tongliang Liu, Gang Niu, Tao Qin, Masashi Sugiyama

Partial-label learning (PLL) solves the multi-class classification problem, where each training instance is assigned a set of candidate labels that include the true label. Recent advances showed that PLL can be compatible with deep neural networks, which achieved state-of-the-art performance. However, most of the existing deep PLL methods focus on designing proper training objectives under various assumptions on the collected data, which may limit their performance when the collected data cannot satisfy the adopted assumptions. In this paper, we propose to exploit the learned intrinsic representation of the model to identify the true label in the training process, which does not rely on any assumptions on the collected data. We make two key contributions. As the first contribution, we empirically show that the class activation map (CAM), a simple technique for discriminating the learning patterns of each class in images, is surprisingly better at making accurate predictions than the model itself on selecting the true label from candidate labels. Unfortunately, as CAM is confined to image inputs with convolutional neural networks, we are yet unable to directly leverage CAM to address the PLL problem with general inputs and models. Thus, as the second contribution, we propose the class activation value (CAV), which owns similar properties of CAM, while CAV is versatile in various types of inputs and models. Building upon CAV, we propose a novel method named CAV Learning (CAVL) that selects the true label by the class with the maximum CAV for model training. Extensive experiments on various datasets demonstrate that our proposed CAVL method achieves state-of-the-art performance.

📄 PDF Abstract BibTeX

Code (3)

2023-MindSpore-1/ms-code-72 mindspore
Ferenas/CAVL pytorch
Shuijing2018/CAVL_Mindspore mindspore

Tasks

Multi-class ClassificationPartial Label Learning

Methods 이 논문이 사용한 방법론

CAM Class activation maps could be used to interpret the prediction decision made by the convolutional neural network (CNN). Image source: [Learning Deep Features for…

Similar Papers 제목 키워드 기반

Robust Partial-Label Learning by Leveraging Class Activation Values

2025-02-17 · Tobias Fuchs, Florian Kalinke

Real-world training data is often noisy; for example, human annotators assign conflicting class labels to the same instances. Partial-label learning (PLL) is a weakly supervised learning paradigm that allows training cla…

Partial Label LearningWeakly-supervised Learning

AugLabel: Exploiting Word Representations to Augment Labels for Face Attribute Classification

2019-07-15 · Binod Bhattarai, Rumeysa Bodur, Tae-Kyun Kim

Augmenting data in image space (eg. flipping, cropping etc) and activation space (eg. dropout) are being widely used to regularise deep neural networks and have been successfully applied on several computer vision tasks.…

AttributeGeneral Classification

LyS at SemEval-2016 Task 4: Exploiting Neural Activation Values for Twitter Sentiment Classification and Quantification

2016-06-01 · SEMEVAL 2016 6 · David Vilares, Yerai Doval, Miguel A. Alonso, Carlos G{\'o}mez-Rodr{\'\i}guez
General ClassificationOpinion MiningSentiment AnalysisSentiment Classification+1

Unreasonable Effectiveness of Last Hidden Layer Activations for Adversarial Robustness

2022-02-15 · Omer Faruk Tuna, Ferhat Ozgur Catak, M. Taner Eskil

In standard Deep Neural Network (DNN) based classifiers, the general convention is to omit the activation function in the last (output) layer and directly apply the softmax function on the logits to get the probability s…

Adversarial Robustness

Informative Class Activation Maps

2021-06-19 · Zhenyue Qin, Dongwoo Kim, Tom Gedeon

We study how to evaluate the quantitative information content of a region within an image for a particular label. To this end, we bridge class activation maps with information theory. We develop an informative class acti…

Classificationimage-classificationImage Classification