paper-with-me

홈 › Papers

Regularizing CNNs using Confusion Penalty Based Label Smoothing for Histopathology Images

2024-03-16 · Somenath Kuiry, Alaka Das, Mita Nasipuri, Nibaran Das

Deep Learning, particularly Convolutional Neural Networks (CNN), has been successful in computer vision tasks and medical image analysis. However, modern CNNs can be overconfident, making them difficult to deploy in real-world scenarios. Researchers propose regularizing techniques, such as Label Smoothing (LS), which introduces soft labels for training data, making the classifier more regularized. LS captures disagreements or lack of confidence in the training phase, making the classifier more regularized. Although LS is quite simple and effective, traditional LS techniques utilize a weighted average between target distribution and a uniform distribution across the classes, which limits the objective of LS as well as the performance. This paper introduces a novel LS technique based on the confusion penalty, which treats model confusion for each class with more importance than others. We have performed extensive experiments with well-known CNN architectures with this technique on publicly available Colorectal Histology datasets and got satisfactory results. Also, we have compared our findings with the State-of-the-art and shown our method's efficacy with Reliability diagrams and t-distributed Stochastic Neighbor Embedding (t-SNE) plots of feature space.

📄 PDF Abstract BibTeX arXiv:2403.10881

Code (0)

등록된 구현이 없습니다.

Tasks

Medical Image Analysis

Methods 이 논문이 사용한 방법론

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Regularizing Neural Networks by Penalizing Confident Output Distributions

2017-01-23 · Gabriel Pereyra, George Tucker, Jan Chorowski, Łukasz Kaiser 외

We systematically explore regularizing neural networks by penalizing low entropy output distributions. We show that penalizing low entropy output distributions, which has been shown to improve exploration in reinforcemen…

General Classificationimage-classificationImage ClassificationLanguage Modeling+7

Regularizing Deep Neural Networks with Stochastic Estimators of Hessian Trace

2022-08-11 · Yucong Liu, Shixing Yu, Tong Lin

In this paper, we develop a novel regularization method for deep neural networks by penalizing the trace of Hessian. This regularizer is motivated by a recent guarantee bound of the generalization error. We explain its b…

Data Augmentation

Improving Time Series Classification with Representation Soft Label Smoothing

2024-08-30 · Hengyi Ma, Weitong Chen

Previous research has indicated that deep neural network based models for time series classification (TSC) tasks are prone to overfitting. This issue can be mitigated by employing strategies that prevent the model from b…

Time SeriesTime Series Classification

T-vMF Similarity for Regularizing Intra-Class Feature Distribution

2021-06-19 · CVPR 2021 1 · Takumi Kobayashi

Deep convolutional neural networks (CNNs) leverage large-scale training dataset to produce remarkable performance on various image classification tasks. It, however, is difficult to effectively train the CNNs on some…

image-classificationImage ClassificationRepresentation Learning

Label Confusion Learning to Enhance Text Classification Models

2020-12-09 · Biyang Guo, Songqiao Han, Xiao Han, Hailiang Huang 외

Representing a true label as a one-hot vector is a common practice in training text classification models. However, the one-hot representation may not adequately reflect the relation between the instances and labels, as …

ClassificationGeneral Classificationtext-classificationText Classification