paper-with-me

Papers

BTMuda: A Bi-level Multi-source unsupervised domain adaptation framework for breast cancer diagnosis

2024-08-30 · Yuxiang Yang, Xinyi Zeng, Pinxian Zeng, Binyu Yan, Xi Wu, Jiliu Zhou, Yan Wang

Deep learning has revolutionized the early detection of breast cancer, resulting in a significant decrease in mortality rates. However, difficulties in obtaining annotations and huge variations in distribution between training sets and real scenes have limited their clinical applications. To address these limitations, unsupervised domain adaptation (UDA) methods have been used to transfer knowledge from one labeled source domain to the unlabeled target domain, yet these approaches suffer from severe domain shift issues and often ignore the potential benefits of leveraging multiple relevant sources in practical applications. To address these limitations, in this work, we construct a Three-Branch Mixed extractor and propose a Bi-level Multi-source unsupervised domain adaptation method called BTMuda for breast cancer diagnosis. Our method addresses the problems of domain shift by dividing domain shift issues into two levels: intra-domain and inter-domain. To reduce the intra-domain shift, we jointly train a CNN and a Transformer as two paths of a domain mixed feature extractor to obtain robust representations rich in both low-level local and high-level global information. As for the inter-domain shift, we redesign the Transformer delicately to a three-branch architecture with cross-attention and distillation, which learns domain-invariant representations from multiple domains. Besides, we introduce two alignment modules - one for feature alignment and one for classifier alignment - to improve the alignment process. Extensive experiments conducted on three public mammographic datasets demonstrate that our BTMuda outperforms state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2408.17054

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationMulti-Source Unsupervised Domain AdaptationUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Memorizing Comprehensively to Learn Adaptively: Unsupervised Cross-Domain Person Re-ID with Multi-level Memory

2020-01-13 · Xin-Yu Zhang, Dong Gong, Jiewei Cao, Chunhua Shen

Unsupervised cross-domain person re-identification (Re-ID) aims to adapt the information from the labelled source domain to an unlabelled target domain. Due to the lack of supervision in the target domain, it is crucial …

Person Re-Identification

Multi-source Unsupervised Domain Adaptation on Graphs with Transferability Modeling

2024-06-14 · Tianxiang Zhao, Dongsheng Luo, Xiang Zhang, Suhang Wang

In this paper, we tackle a new problem of \textit{multi-source unsupervised domain adaptation (MSUDA) for graphs}, where models trained on annotated source domains need to be transferred to the unsupervised target graph …

Domain AdaptationMeta-LearningMulti-Source Unsupervised Domain AdaptationNode Classification+1

Multi-Target Domain Adaptation with Collaborative Consistency Learning

2021-06-07 · CVPR 2021 1 · Takashi Isobe, Xu Jia, Shuaijun Chen, Jianzhong He 외

Recently unsupervised domain adaptation for the semantic segmentation task has become more and more popular due to high-cost of pixel-level annotation on real-world images. However, most domain adaptation methods are onl…

Domain AdaptationMulti-target Domain AdaptationSemantic SegmentationUnsupervised Domain Adaptation

Preserving Semantic Consistency in Unsupervised Domain Adaptation Using Generative Adversarial Networks

2021-04-28 · Mohammad Mahfujur Rahman, Clinton Fookes, Sridha Sridharan

Unsupervised domain adaptation seeks to mitigate the distribution discrepancy between source and target domains, given labeled samples of the source domain and unlabeled samples of the target domain. Generative adversari…

Domain AdaptationGenerative Adversarial NetworkUnsupervised Domain Adaptation

Transferable Feature Learning on Graphs Across Visual Domains

2021-01-01 · Ronghang Zhu, Xiaodong Jiang, Jiasen Lu, Sheng Li

Unsupervised domain adaptation has attracted increasing attention in recent years, which adapts classifiers to an unlabeled target domain by exploiting a labeled source domain. To reduce discrepancy between source and ta…

Domain AdaptationUnsupervised Domain Adaptation