FocusNet: Classifying Better by Focusing on Confusing Classes
Nowadays, most classification networks use one-hot encoding to represent categorical data because of its simplicity. However, one-hot encoding may affect the generalization ability as it neglects inter-class correlations. We observe that, even when a neural network trained with one-hot labels produces incorrect predictions, it still pays attention to the target image region and reveals which classes confuse the network. Inspired by this observation, we propose a confusion-focusing mechanism to address the class-confusion issue. Our confusion-focusing mechanism is implemented by a two-branch network architecture. Its baseline branch generates confusing classes, and its FocusNet branch, whose architecture is flexible, discriminates correct labels from these confusing classes. We also introduce a novel focus-picking loss function to improve classification accuracy by encouraging FocusNet to focus on the most confusing classes. The experimental results validate that our FocusNet is effective for image classification on common datasets, and that our focus-picking loss function can also benefit the current neural networks in improving their classification accuracy.
Code (2)
Tasks
Classificationimage-classificationImage ClassificationKnowledge DistillationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Data Efficient Acoustic Scene Classification using Teacher-Informed Confusing Class Instruction
In this technical report, we describe the SNTL-NTU team's submission for Task 1 Data-Efficient Low-Complexity Acoustic Scene Classification of the detection and classification of acoustic scenes and events (DCASE) 2024 c…
Acoustic Scene ClassificationData AugmentationDiversityKnowledge Distillation+1FocusNet: Transformer-enhanced Polyp Segmentation with Local and Pooling Attention
Colonoscopy is vital in the early diagnosis of colorectal polyps. Regular screenings can effectively prevent benign polyps from progressing to CRC. While deep learning has made impressive strides in polyp segmentation, m…
DecoderSegmentationFocusNet++: Attentive Aggregated Transformations for Efficient and Accurate Medical Image Segmentation
We propose a new residual block for convolutional neural networks and demonstrate its state-of-the-art performance in medical image segmentation. We combine attention mechanisms with group convolutions to create our grou…
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationProgressive Class-based Expansion Learning For Image Classification
In this paper, we propose a novel image process scheme called class-based expansion learning for image classification, which aims at improving the supervision-stimulation frequency for the samples of the confusing classe…
Classificationimage-classificationImage ClassificationConfusing Pair Correction Based on Category Prototype for Domain Adaptation under Noisy Environments
In this paper, we address unsupervised domain adaptation under noisy environments, which is more challenging and practical than traditional domain adaptation. In this scenario, the model is prone to overfitting noisy lab…
Domain AdaptationUnsupervised Domain Adaptation