What Can Be Transferred: Unsupervised Domain Adaptation for Endoscopic Lesions Segmentation
Unsupervised domain adaptation has attracted growing research attention on semantic segmentation. However, 1) most existing models cannot be directly applied into lesions transfer of medical images, due to the diverse appearances of same lesion among different datasets; 2) equal attention has been paid into all semantic representations instead of neglecting irrelevant knowledge, which leads to negative transfer of untransferable knowledge. To address these challenges, we develop a new unsupervised semantic transfer model including two complementary modules (i.e., T_D and T_F ) for endoscopic lesions segmentation, which can alternatively determine where and how to explore transferable domain-invariant knowledge between labeled source lesions dataset (e.g., gastroscope) and unlabeled target diseases dataset (e.g., enteroscopy). Specifically, T_D focuses on where to translate transferable visual information of medical lesions via residual transferability-aware bottleneck, while neglecting untransferable visual characterizations. Furthermore, T_F highlights how to augment transferable semantic features of various lesions and automatically ignore untransferable representations, which explores domain-invariant knowledge and in return improves the performance of T_D. To the end, theoretical analysis and extensive experiments on medical endoscopic dataset and several non-medical public datasets well demonstrate the superiority of our proposed model.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationSemantic SegmentationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Visualizing Transferred Knowledge: An Interpretive Model of Unsupervised Domain Adaptation
Many research efforts have been committed to unsupervised domain adaptation (DA) problems that transfer knowledge learned from a labeled source domain to an unlabeled target domain. Various DA methods have achieved remar…
Domain AdaptationUnsupervised Domain AdaptationSimulation-to-Real domain adaptation with teacher-student learning for endoscopic instrument segmentation
Purpose: Segmentation of surgical instruments in endoscopic videos is essential for automated surgical scene understanding and process modeling. However, relying on fully supervised deep learning for this task is challen…
Domain AdaptationScene UnderstandingSegmentationUnsupervised Domain AdaptationDRANet: Disentangling Representation and Adaptation Networks for Unsupervised Cross-Domain Adaptation
In this paper, we present DRANet, a network architecture that disentangles image representations and transfers the visual attributes in a latent space for unsupervised cross-domain adaptation. Unlike the existing domain …
DecoderDomain AdaptationA General Representation-Based Approach to Multi-Source Domain Adaptation
A central problem in unsupervised domain adaptation is determining what to transfer from labeled source domains to an unlabeled target domain. To handle high-dimensional observations (e.g., images), a line of approaches …
Unsupervised Domain AdaptationMonocular absolute depth estimation from endoscopy via domain-invariant feature learning and latent consistency
Monocular depth estimation (MDE) is a critical task to guide autonomous medical robots. However, obtaining absolute (metric) depth from an endoscopy camera in surgical scenes is difficult, which limits supervised learnin…
Unsupervised Domain AdaptationMonocular Depth Estimation