Few-shot Medical Image Segmentation via Cross-Reference Transformer
Deep learning models have become the mainstream method for medical image segmentation, but they require a large manually labeled dataset for training and are difficult to extend to unseen categories. Few-shot segmentation(FSS) has the potential to address these challenges by learning new categories from a small number of labeled samples. The majority of the current methods employ a prototype learning architecture, which involves expanding support prototype vectors and concatenating them with query features to conduct conditional segmentation. However, such framework potentially focuses more on query features while may neglect the correlation between support and query features. In this paper, we propose a novel self-supervised few shot medical image segmentation network with Cross-Reference Transformer, which addresses the lack of interaction between the support image and the query image. We first enhance the correlation features between the support set image and the query image using a bidirectional cross-attention module. Then, we employ a cross-reference mechanism to mine and enhance the similar parts of support features and query features in high-dimensional channels. Experimental results show that the proposed model achieves good results on both CT dataset and MRI dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
One-shot Localization and Segmentation of Medical Images with Foundation Models
Recent advances in Vision Transformers (ViT) and Stable Diffusion (SD) models with their ability to capture rich semantic features of the image have been used for image correspondence tasks on natural images. In this pap…
SegmentationSemantic SegmentationBoosting SAM for Cross-Domain Few-Shot Segmentation via Conditional Point Sparsification
Motivated by the success of the Segment Anything Model (SAM) in promptable segmentation, recent studies leverage SAM to develop training-free solutions for few-shot segmentation, which aims to predict object masks in the…
Cross-Domain Few-ShotBeyond Static Anchors: Bounded Prototype Conditioning for Language-Free Medical Anomaly Detection
Medical anomaly detection identifies abnormal images and localizes lesions under scarce supervision while generalizing across organs and modalities. Existing CLIP-based methods reduce annotation requirements through visi…
Anomaly DetectionDistillation Learning Guided by Image Reconstruction for One-Shot Medical Image Segmentation
Traditional one-shot medical image segmentation (MIS) methods use registration networks to propagate labels from a reference atlas or rely on comprehensive sampling strategies to generate synthetic labeled data for train…
Data AugmentationImage ReconstructionImage SegmentationKnowledge Distillation+3Show and Segment: Universal Medical Image Segmentation via In-Context Learning
Medical image segmentation remains challenging due to the vast diversity of anatomical structures, imaging modalities, and segmentation tasks. While deep learning has made significant advances, current approaches struggl…
Image SegmentationIn-Context LearningMedical Image SegmentationSegmentation+1