FVP: Fourier Visual Prompting for Source-Free Unsupervised Domain Adaptation of Medical Image Segmentation
Medical image segmentation methods normally perform poorly when there is a domain shift between training and testing data. Unsupervised Domain Adaptation (UDA) addresses the domain shift problem by training the model using both labeled data from the source domain and unlabeled data from the target domain. Source-Free UDA (SFUDA) was recently proposed for UDA without requiring the source data during the adaptation, due to data privacy or data transmission issues, which normally adapts the pre-trained deep model in the testing stage. However, in real clinical scenarios of medical image segmentation, the trained model is normally frozen in the testing stage. In this paper, we propose Fourier Visual Prompting (FVP) for SFUDA of medical image segmentation. Inspired by prompting learning in natural language processing, FVP steers the frozen pre-trained model to perform well in the target domain by adding a visual prompt to the input target data. In FVP, the visual prompt is parameterized using only a small amount of low-frequency learnable parameters in the input frequency space, and is learned by minimizing the segmentation loss between the predicted segmentation of the prompted target image and reliable pseudo segmentation label of the target image under the frozen model. To our knowledge, FVP is the first work to apply visual prompts to SFUDA for medical image segmentation. The proposed FVP is validated using three public datasets, and experiments demonstrate that FVP yields better segmentation results, compared with various existing methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationUnsupervised Domain AdaptationVisual PromptingSimilar Papers 제목 키워드 기반
Fourier-Net: Fast Image Registration with Band-limited Deformation
Unsupervised image registration commonly adopts U-Net style networks to predict dense displacement fields in the full-resolution spatial domain. For high-resolution volumetric image data, this process is however resource…
DecoderImage RegistrationMedical Image RegistrationUnsupervised Image RegistrationMRPD: Undersampled MRI reconstruction by prompting a large latent diffusion model
Implicit visual knowledge in a large latent diffusion model (LLDM) pre-trained on natural images is rich and hypothetically universal to natural and medical images. To test this hypothesis from a practical perspective, w…
MRI ReconstructionFourier-Net+: Leveraging Band-Limited Representation for Efficient 3D Medical Image Registration
U-Net style networks are commonly utilized in unsupervised image registration to predict dense displacement fields, which for high-resolution volumetric image data is a resource-intensive and time-consuming task. To tack…
DecoderImage RegistrationMedical Image RegistrationUnsupervised Image RegistrationDomain-Agnostic Mutual Prompting for Unsupervised Domain Adaptation
Conventional Unsupervised Domain Adaptation (UDA) strives to minimize distribution discrepancy between domains, which neglects to harness rich semantics from data and struggles to handle complex domain shifts. A promisin…
Domain AdaptationTransfer LearningUnsupervised Domain AdaptationStrucSum: Graph-Structured Reasoning for Long Document Extractive Summarization with LLMs
Large language models (LLMs) have shown strong performance in zero-shot summarization, but often struggle to model document structure and identify salient information in long texts. In this work, we introduce StrucSum, a…
Extractive SummarizationSentence