paper-with-me

Papers

One Size Doesn't Fit All: Adaptive Label Smoothing

2021-01-01 · Ujwal Krothapalli, Lynn Abbott

This paper concerns the use of objectness measures to improve the calibration performance of Convolutional Neural Networks (CNNs). Objectness is a measure of likelihood of an object from \textit{any} class being present in a given image. CNNs have proven to be very good classifiers and generally localize objects well; however, the loss functions typically used to train classification CNNs do not penalize inability to localize an object, nor do they take into account an object's relative size in the given image. During training on ImageNet-1K almost all approaches use random crops on the images and this transformation sometimes provides the CNN with background only samples with the correct label,this causes the classifiers to overfit to context. Context dependence is harmful for safety-critical applications. We present a novel approach to object localization that combines the ideas of objectness and label smoothing during training. Unlike previous methods, we compute a smoothing factor that is \emph{adaptive} based on relative object size within an image. This causes our approach to produce confidences that are grounded in the size of the object being classified instead of relying on context to make the correct predictions. We present extensive results using ImageNet to demonstrate that CNNs trained using adaptive label smoothing are much less likely to be overconfident in their predictions, as compared to CNNs trained using hard targets. We also show qualitative results using class activation maps to illustrate the improvements.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

AllObjectObject Localization

Methods 이 논문이 사용한 방법론

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Adaptive Label Smoothing

2020-09-14 · Ujwal Krothapalli, A. Lynn Abbott

This paper concerns the use of objectness measures to improve the calibration performance of Convolutional Neural Networks (CNNs). CNNs have proven to be very good classifiers and generally localize objects well; however…

General ClassificationObject LocalizationTransfer Learning

Combined Image Data Augmentations diminish the benefits of Adaptive Label Smoothing

2025-07-22 · Georg Siedel, Ekagra Gupta, Weijia Shao, Silvia Vock 외 arxiv

Soft augmentation regularizes the supervised learning process of image classifiers by reducing label confidence of a training sample based on the magnitude of random-crop augmentation applied to it. This paper extends th…

Data Augmentation

Variational Learning Induces Adaptive Label Smoothing

2025-02-11 · Sin-Han Yang, Zhedong Liu, Gian Maria Marconi, Mohammad Emtiyaz Khan

We show that variational learning naturally induces an adaptive label smoothing where label noise is specialized for each example. Such label-smoothing is useful to handle examples with labeling errors and distribution s…

Learning Better Structured Representations Using Low-rank Adaptive Label Smoothing

2021-01-01 · ICLR 2021 1 · Asish Ghoshal, Xilun Chen, Sonal Gupta, Luke Zettlemoyer 외

Training with soft targets instead of hard targets has been shown to improve performance and calibration of deep neural networks. Label smoothing is popular way of computing soft targets, where one-hot encoding of a clas…

Generalization BoundsMachine TranslationSemantic ParsingStructured Prediction+2

Efficient and Adaptive Linear Regression in Semi-Supervised Settings

2017-01-17 · Abhishek Chakrabortty, Tianxi Cai

We consider the linear regression problem under semi-supervised settings wherein the available data typically consists of: (i) a small or moderate sized 'labeled' data, and (ii) a much larger sized 'unlabeled' data. Such…

Imputationregression