paper-with-me

Papers

MSCDA: Multi-level Semantic-guided Contrast Improves Unsupervised Domain Adaptation for Breast MRI Segmentation in Small Datasets

2023-01-04 · Sheng Kuang, Henry C. Woodruff, Renee Granzier, Thiemo J. A. van Nijnatten, Marc B. I. Lobbes, Marjolein L. Smidt, Philippe Lambin, Siamak Mehrkanoon

Deep learning (DL) applied to breast tissue segmentation in magnetic resonance imaging (MRI) has received increased attention in the last decade, however, the domain shift which arises from different vendors, acquisition protocols, and biological heterogeneity, remains an important but challenging obstacle on the path towards clinical implementation. In this paper, we propose a novel Multi-level Semantic-guided Contrastive Domain Adaptation (MSCDA) framework to address this issue in an unsupervised manner. Our approach incorporates self-training with contrastive learning to align feature representations between domains. In particular, we extend the contrastive loss by incorporating pixel-to-pixel, pixel-to-centroid, and centroid-to-centroid contrasts to better exploit the underlying semantic information of the image at different levels. To resolve the data imbalance problem, we utilize a category-wise cross-domain sampling strategy to sample anchors from target images and build a hybrid memory bank to store samples from source images. We have validated MSCDA with a challenging task of cross-domain breast MRI segmentation between datasets of healthy volunteers and invasive breast cancer patients. Extensive experiments show that MSCDA effectively improves the model's feature alignment capabilities between domains, outperforming state-of-the-art methods. Furthermore, the framework is shown to be label-efficient, achieving good performance with a smaller source dataset. The code is publicly available at \url{https://github.com/ShengKuangCN/MSCDA}.

📄 PDF Abstract BibTeX arXiv:2301.02554

Code (1)

shengkuangcn/mscda 공식 구현 pytorch

Tasks

Contrastive LearningDomain AdaptationMRI segmentationUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Language-guided Medical Image Segmentation with Target-informed Multi-level Contrastive Alignments

2024-12-18 · Mingjian Li, Mingyuan Meng, Shuchang Ye, David Dagan Feng 외

Medical image segmentation is crucial in modern medical image analysis, which can aid into diagnosis of various disease conditions. Recently, language-guided segmentation methods have shown promising results in automatin…

Image SegmentationMedical Image AnalysisMedical Image SegmentationRepresentation Learning+2

Hierarchical Semantic Contrast for Weakly Supervised Semantic Segmentation

2023-08-01 · Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence 2023 8 · Yuanchen Wu, Xiaoqiang Li, Songmin Dai, Jide Li 외

Weakly supervised semantic segmentation (WSSS) with image-level annotations has achieved great processes through class activation map (CAM). Since vanilla CAMs are hardly served as guidance to bridge the gap between full…

Semantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic Segmentation

On the Utility of Foundation Models for Fast MRI: Vision-Language-Guided Image Reconstruction

2025-11-24 · Ruimin Feng, Xingxin He, Ronald Mercer, Zachary Stewart 외 arxiv

Purpose: To investigate whether a vision-language foundation model can enhance undersampled MRI reconstruction by providing high-level contextual information beyond conventional priors. Methods: We proposed a semantic di…

Image ReconstructionMRI Reconstruction

PeVL: Pose-Enhanced Vision-Language Model for Fine-Grained Human Action Recognition

2024-01-01 · CVPR 2024 1 · Haosong Zhang, Mei Chee Leong, Liyuan Li, Weisi Lin

Recent progress in Vision-Language (VL) foundation models has revealed the great advantages of cross-modality learning. However due to a large gap between vision and text they might not be able to sufficiently utiliz…

Action RecognitionContrastive LearningLanguage ModelingLanguage Modelling+1

Face-Guided Sentiment Boundary Enhancement for Weakly-Supervised Temporal Sentiment Localization

2026-03-16 · Cailing Han, Zhangbin Li, Jinxing Zhou, Wei Qian 외 arxiv

Point-level weakly-supervised temporal sentiment localization (P-WTSL) aims to detect sentiment-relevant segments in untrimmed multimodal videos using timestamp sentiment annotations, which greatly reduces the costly fra…

Contrastive Learning