paper-with-me

홈 › Papers

FVP: Fourier Visual Prompting for Source-Free Unsupervised Domain Adaptation of Medical Image Segmentation

2023-04-26 · Yan Wang, Jian Cheng, Yixin Chen, Shuai Shao, Lanyun Zhu, Zhenzhou Wu, Tao Liu, Haogang Zhu

Medical image segmentation methods normally perform poorly when there is a domain shift between training and testing data. Unsupervised Domain Adaptation (UDA) addresses the domain shift problem by training the model using both labeled data from the source domain and unlabeled data from the target domain. Source-Free UDA (SFUDA) was recently proposed for UDA without requiring the source data during the adaptation, due to data privacy or data transmission issues, which normally adapts the pre-trained deep model in the testing stage. However, in real clinical scenarios of medical image segmentation, the trained model is normally frozen in the testing stage. In this paper, we propose Fourier Visual Prompting (FVP) for SFUDA of medical image segmentation. Inspired by prompting learning in natural language processing, FVP steers the frozen pre-trained model to perform well in the target domain by adding a visual prompt to the input target data. In FVP, the visual prompt is parameterized using only a small amount of low-frequency learnable parameters in the input frequency space, and is learned by minimizing the segmentation loss between the predicted segmentation of the prompted target image and reliable pseudo segmentation label of the target image under the frozen model. To our knowledge, FVP is the first work to apply visual prompts to SFUDA for medical image segmentation. The proposed FVP is validated using three public datasets, and experiments demonstrate that FVP yields better segmentation results, compared with various existing methods.

📄 PDF Abstract BibTeX arXiv:2304.13672

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationImage SegmentationMedical Image SegmentationSegmentationSemantic SegmentationUnsupervised Domain AdaptationVisual Prompting

Similar Papers 제목 키워드 기반

Fourier-Net: Fast Image Registration with Band-limited Deformation

2022-11-29 · Xi Jia, Joseph Bartlett, Wei Chen, Siyang Song 외

Unsupervised image registration commonly adopts U-Net style networks to predict dense displacement fields in the full-resolution spatial domain. For high-resolution volumetric image data, this process is however resource…

DecoderImage RegistrationMedical Image RegistrationUnsupervised Image Registration

MRPD: Undersampled MRI reconstruction by prompting a large latent diffusion model

2024-02-16 · Ziqi Gao, S. Kevin Zhou

Implicit visual knowledge in a large latent diffusion model (LLDM) pre-trained on natural images is rich and hypothetically universal to natural and medical images. To test this hypothesis from a practical perspective, w…

MRI Reconstruction

Fourier-Net+: Leveraging Band-Limited Representation for Efficient 3D Medical Image Registration

2023-07-06 · Xi Jia, Alexander Thorley, Alberto Gomez, Wenqi Lu 외

U-Net style networks are commonly utilized in unsupervised image registration to predict dense displacement fields, which for high-resolution volumetric image data is a resource-intensive and time-consuming task. To tack…

DecoderImage RegistrationMedical Image RegistrationUnsupervised Image Registration

Domain-Agnostic Mutual Prompting for Unsupervised Domain Adaptation

2024-03-05 · CVPR 2024 1 · Zhekai Du, Xinyao Li, Fengling Li, Ke Lu 외

Conventional Unsupervised Domain Adaptation (UDA) strives to minimize distribution discrepancy between domains, which neglects to harness rich semantics from data and struggles to handle complex domain shifts. A promisin…

Domain AdaptationTransfer LearningUnsupervised Domain Adaptation

StrucSum: Graph-Structured Reasoning for Long Document Extractive Summarization with LLMs

2025-05-29 · Haohan Yuan, Sukhwa Hong, Haopeng Zhang

Large language models (LLMs) have shown strong performance in zero-shot summarization, but often struggle to model document structure and identify salient information in long texts. In this work, we introduce StrucSum, a…

Extractive SummarizationSentence