Deeply Supervised Layer Selective Attention Network: Towards Label-Efficient Learning for Medical Image Classification
Labeling medical images depends on professional knowledge, making it difficult to acquire large amount of annotated medical images with high quality in a short time. Thus, making good use of limited labeled samples in a small dataset to build a high-performance model is the key to medical image classification problem. In this paper, we propose a deeply supervised Layer Selective Attention Network (LSANet), which comprehensively uses label information in feature-level and prediction-level supervision. For feature-level supervision, in order to better fuse the low-level features and high-level features, we propose a novel visual attention module, Layer Selective Attention (LSA), to focus on the feature selection of different layers. LSA introduces a weight allocation scheme which can dynamically adjust the weighting factor of each auxiliary branch during the whole training process to further enhance deeply supervised learning and ensure its generalization. For prediction-level supervision, we adopt the knowledge synergy strategy to promote hierarchical information interactions among all supervision branches via pairwise knowledge matching. Using the public dataset, MedMNIST, which is a large-scale benchmark for biomedical image classification covering diverse medical specialties, we evaluate LSANet on multiple mainstream CNN architectures and various visual attention modules. The experimental results show the substantial improvements of our proposed method over its corresponding counterparts, demonstrating that LSANet can provide a promising solution for label-efficient learning in the field of medical image classification.
Code (0)
등록된 구현이 없습니다.
Tasks
feature selectionimage-classificationImage ClassificationMedical Image ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deeply Supervised Active Learning for Finger Bones Segmentation
Segmentation is a prerequisite yet challenging task for medical image analysis. In this paper, we introduce a novel deeply supervised active learning approach for finger bones segmentation. The proposed architecture is f…
Active LearningIncremental LearningMedical Image AnalysisSegmentationDSAMNet: A Deeply Supervised Attention Metric Based Network for Change Detection of High-Resolution Images
In view of the insufficient of current change detection, we propose a deeply-supervised attention metric-based network (DSAMNet) for bi-temporal image change detection. The DSAMNet contains a CBAM integrated change decis…
Change DetectionChange detection for remote sensing imagesDeeply-Supervised Recurrent Convolutional Neural Network for Saliency Detection
This paper proposes a novel saliency detection method by developing a deeply-supervised recurrent convolutional neural network (DSRCNN), which performs a full image-to-image saliency prediction. For saliency detection, t…
Saliency DetectionSaliency PredictionSelf-Attention Enhanced Selective Gate with Entity-Aware Embedding for Distantly Supervised Relation Extraction
Distantly supervised relation extraction intrinsically suffers from noisy labels due to the strong assumption of distant supervision. Most prior works adopt a selective attention mechanism over sentences in a bag to deno…
Entity EmbeddingsRelationRelation ClassificationRelation Extraction+2SAAN: Similarity-aware attention flow network for change detection with VHR remote sensing images
Change detection (CD) is a fundamental and important task for monitoring the land surface dynamics in the earth observation field. Existing deep learning-based CD methods typically extract bi-temporal image features usin…
Change DetectionDecoderEarth Observation