Pyramid Pixel Context Adaption Network for Medical Image Classification with Supervised Contrastive Learning
Spatial attention mechanism has been widely incorporated into deep neural networks (DNNs), significantly lifting the performance in computer vision tasks via long-range dependency modeling. However, it may perform poorly in medical image analysis. Unfortunately, existing efforts are often unaware that long-range dependency modeling has limitations in highlighting subtle lesion regions. To overcome this limitation, we propose a practical yet lightweight architectural unit, Pyramid Pixel Context Adaption (PPCA) module, which exploits multi-scale pixel context information to recalibrate pixel position in a pixel-independent manner dynamically. PPCA first applies a well-designed cross-channel pyramid pooling to aggregate multi-scale pixel context information, then eliminates the inconsistency among them by the well-designed pixel normalization, and finally estimates per pixel attention weight via a pixel context integration. By embedding PPCA into a DNN with negligible overhead, the PPCANet is developed for medical image classification. In addition, we introduce supervised contrastive learning to enhance feature representation by exploiting the potential of label information via supervised contrastive loss. The extensive experiments on six medical image datasets show that PPCANet outperforms state-of-the-art attention-based networks and recent deep neural networks. We also provide visual analysis and ablation study to explain the behavior of PPCANet in the decision-making process.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningDecision Makingimage-classificationImage ClassificationMedical Image AnalysisMedical Image ClassificationSimilar Papers 제목 키워드 기반
Parallel Multi-Dimensional LSTM, With Application to Fast Biomedical Volumetric Image Segmentation
Convolutional Neural Networks (CNNs) can be shifted across 2D images or 3D videos to segment them. They have a fixed input size and typically perceive only small local contexts of the pixels to be classified as foregroun…
Brain Image SegmentationImage SegmentationSemantic SegmentationCANet: Context aware network with dual-stream pyramid for medical image segmentation
Owing to the various object types and scales, complicated backgrounds, and similar appearance between tissues in medical images, it is difficult to extract some valuable information from different medical images. In this…
2D Semantic SegmentationDecoderImage SegmentationMedical Image Segmentation+3PCRLv2: A Unified Visual Information Preservation Framework for Self-supervised Pre-training in Medical Image Analysis
Recent advances in self-supervised learning (SSL) in computer vision are primarily comparative, whose goal is to preserve invariant and discriminative semantics in latent representations by comparing siamese image views.…
Brain Tumor SegmentationMedical Image AnalysisOrgan SegmentationSegmentation+2DeepPyramid+: Medical Image Segmentation using Pyramid View Fusion and Deformable Pyramid Reception
Semantic Segmentation plays a pivotal role in many applications related to medical image and video analysis. However, designing a neural network architecture for medical image and surgical video segmentation is challengi…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+2Spatial Attention Pyramid Network for Unsupervised Domain Adaptation
Unsupervised domain adaptation is critical in various computer vision tasks, such as object detection, instance segmentation, and semantic segmentation, which aims to alleviate performance degradation caused by domain-sh…
Domain AdaptationInstance Segmentationobject-detectionObject Detection+3