Regularizing CNNs using Confusion Penalty Based Label Smoothing for Histopathology Images
Deep Learning, particularly Convolutional Neural Networks (CNN), has been successful in computer vision tasks and medical image analysis. However, modern CNNs can be overconfident, making them difficult to deploy in real-world scenarios. Researchers propose regularizing techniques, such as Label Smoothing (LS), which introduces soft labels for training data, making the classifier more regularized. LS captures disagreements or lack of confidence in the training phase, making the classifier more regularized. Although LS is quite simple and effective, traditional LS techniques utilize a weighted average between target distribution and a uniform distribution across the classes, which limits the objective of LS as well as the performance. This paper introduces a novel LS technique based on the confusion penalty, which treats model confusion for each class with more importance than others. We have performed extensive experiments with well-known CNN architectures with this technique on publicly available Colorectal Histology datasets and got satisfactory results. Also, we have compared our findings with the State-of-the-art and shown our method's efficacy with Reliability diagrams and t-distributed Stochastic Neighbor Embedding (t-SNE) plots of feature space.
Code (0)
등록된 구현이 없습니다.
Tasks
Medical Image AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Regularizing Neural Networks by Penalizing Confident Output Distributions
We systematically explore regularizing neural networks by penalizing low entropy output distributions. We show that penalizing low entropy output distributions, which has been shown to improve exploration in reinforcemen…
General Classificationimage-classificationImage ClassificationLanguage Modeling+7Regularizing Deep Neural Networks with Stochastic Estimators of Hessian Trace
In this paper, we develop a novel regularization method for deep neural networks by penalizing the trace of Hessian. This regularizer is motivated by a recent guarantee bound of the generalization error. We explain its b…
Data AugmentationImproving Time Series Classification with Representation Soft Label Smoothing
Previous research has indicated that deep neural network based models for time series classification (TSC) tasks are prone to overfitting. This issue can be mitigated by employing strategies that prevent the model from b…
Time SeriesTime Series ClassificationT-vMF Similarity for Regularizing Intra-Class Feature Distribution
Deep convolutional neural networks (CNNs) leverage large-scale training dataset to produce remarkable performance on various image classification tasks. It, however, is difficult to effectively train the CNNs on some…
image-classificationImage ClassificationRepresentation LearningLabel Confusion Learning to Enhance Text Classification Models
Representing a true label as a one-hot vector is a common practice in training text classification models. However, the one-hot representation may not adequately reflect the relation between the instances and labels, as …
ClassificationGeneral Classificationtext-classificationText Classification