Q-Net: Query-Informed Few-Shot Medical Image Segmentation
Deep learning has achieved tremendous success in computer vision, while medical image segmentation (MIS) remains a challenge, due to the scarcity of data annotations. Meta-learning techniques for few-shot segmentation (Meta-FSS) have been widely used to tackle this challenge, while they neglect possible distribution shifts between the query image and the support set. In contrast, an experienced clinician can perceive and address such shifts by borrowing information from the query image, then fine-tune or calibrate her prior cognitive model accordingly. Inspired by this, we propose Q-Net, a Query-informed Meta-FSS approach, which mimics in spirit the learning mechanism of an expert clinician. We build Q-Net based on ADNet, a recently proposed anomaly detection-inspired method. Specifically, we add two query-informed computation modules into ADNet, namely a query-informed threshold adaptation module and a query-informed prototype refinement module. Combining them with a dual-path extension of the feature extraction module, Q-Net achieves state-of-the-art performance on widely used abdominal and cardiac magnetic resonance (MR) image datasets. Our work sheds light on a novel way to improve Meta-FSS techniques by leveraging query information.
Code (1)
Tasks
Anomaly DetectionImage SegmentationMedical Image SegmentationMeta-LearningSemantic SegmentationSimilar Papers 제목 키워드 기반
Few-shot Medical Image Segmentation with Cycle-resemblance Attention
Recently, due to the increasing requirements of medical imaging applications and the professional requirements of annotating medical images, few-shot learning has gained increasing attention in the medical image semantic…
Few-Shot LearningImage SegmentationMedical Image SegmentationRelation+2Few-shot Medical Image Segmentation via Cross-Reference Transformer
Deep learning models have become the mainstream method for medical image segmentation, but they require a large manually labeled dataset for training and are difficult to extend to unseen categories. Few-shot segmentatio…
Few-Shot LearningImage SegmentationMedical Image SegmentationSegmentation+1Few Shot Medical Image Segmentation with Cross Attention Transformer
Medical image segmentation has made significant progress in recent years. Deep learning-based methods are recognized as data-hungry techniques, requiring large amounts of data with manual annotations. However, manual ann…
Few-Shot LearningImage SegmentationMedical Image AnalysisMedical Image Segmentation+2Rethinking Few-Shot Medical Image Segmentation by SAM2: A Training-Free Framework with Augmentative Prompting and Dynamic Matching
The reliance on large labeled datasets presents a significant challenge in medical image segmentation. Few-shot learning offers a potential solution, but existing methods often still require substantial training data. Th…
Data AugmentationFew-Shot LearningImage SegmentationMedical Image Segmentation+4SPENet: Self-guided Prototype Enhancement Network for Few-shot Medical Image Segmentation
Few-Shot Medical Image Segmentation (FSMIS) aims to segment novel classes of medical objects using only a few labeled images. Prototype-based methods have made significant progress in addressing FSMIS. However, they typi…
Medical Image Segmentation