paper-with-me

홈 › Papers

Dual-Teacher++: Exploiting Intra-domain and Inter-domain Knowledge with Reliable Transfer for Cardiac Segmentation

2021-01-07 · Kang Li, Shujun Wang, Lequan Yu, Pheng-Ann Heng

Annotation scarcity is a long-standing problem in medical image analysis area. To efficiently leverage limited annotations, abundant unlabeled data are additionally exploited in semi-supervised learning, while well-established cross-modality data are investigated in domain adaptation. In this paper, we aim to explore the feasibility of concurrently leveraging both unlabeled data and cross-modality data for annotation-efficient cardiac segmentation. To this end, we propose a cutting-edge semi-supervised domain adaptation framework, namely Dual-Teacher++. Besides directly learning from limited labeled target domain data (e.g., CT) via a student model adopted by previous literature, we design novel dual teacher models, including an inter-domain teacher model to explore cross-modality priors from source domain (e.g., MR) and an intra-domain teacher model to investigate the knowledge beneath unlabeled target domain. In this way, the dual teacher models would transfer acquired inter- and intra-domain knowledge to the student model for further integration and exploitation. Moreover, to encourage reliable dual-domain knowledge transfer, we enhance the inter-domain knowledge transfer on the samples with higher similarity to target domain after appearance alignment, and also strengthen intra-domain knowledge transfer of unlabeled target data with higher prediction confidence. In this way, the student model can obtain reliable dual-domain knowledge and yield improved performance on target domain data. We extensively evaluated the feasibility of our method on the MM-WHS 2017 challenge dataset. The experiments have demonstrated the superiority of our framework over other semi-supervised learning and domain adaptation methods. Moreover, our performance gains could be yielded in bidirections,i.e., adapting from MR to CT, and from CT to MR.

📄 PDF Abstract BibTeX arXiv:2101.02375

Code (1)

kli-lalala/Dual-Teacher- 공식 구현 pytorch

Tasks

Cardiac SegmentationDomain AdaptationMedical Image AnalysisSemi-supervised Domain AdaptationTransfer Learning

Similar Papers 제목 키워드 기반

Dual-Teacher: Integrating Intra-domain and Inter-domain Teachers for Annotation-efficient Cardiac Segmentation

2020-07-13 · Kang Li, Shujun Wang, Lequan Yu, Pheng-Ann Heng

Medical image annotations are prohibitively time-consuming and expensive to obtain. To alleviate annotation scarcity, many approaches have been developed to efficiently utilize extra information, e.g.,semi-supervised lea…

Cardiac SegmentationDomain AdaptationImage SegmentationKnowledge Distillation+4

Less or More From Teacher: Exploiting Trilateral Geometry For Knowledge Distillation

2023-12-22 · Chengming Hu, Haolun Wu, Xuan Li, Chen Ma 외

Knowledge distillation aims to train a compact student network using soft supervision from a larger teacher network and hard supervision from ground truths. However, determining an optimal knowledge fusion ratio that bal…

Bilevel OptimizationClick-Through Rate Predictionimage-classificationImage Classification+2

Semi-supervised Domain Adaptation via Sample-to-Sample Self-Distillation

2021-11-29 · Jeongbeen Yoon, Dahyun Kang, Minsu Cho

Semi-supervised domain adaptation (SSDA) is to adapt a learner to a new domain with only a small set of labeled samples when a large labeled dataset is given on a source domain. In this paper, we propose a pair-based SSD…

Domain AdaptationSemi-supervised Domain Adaptation

CAT: Exploiting Inter-Class Dynamics for Domain Adaptive Object Detection

2024-03-28 · CVPR 2024 1 · Mikhail Kennerley, Jian-Gang Wang, Bharadwaj Veeravalli, Robby T. Tan

Domain adaptive object detection aims to adapt detection models to domains where annotated data is unavailable. Existing methods have been proposed to address the domain gap using the semi-supervised student-teacher fram…

Domain Adaptationobject-detectionObject Detection

Dual Teacher Knowledge Distillation with Domain Alignment for Face Anti-spoofing

2024-01-02 · Zhe Kong, Wentian Zhang, Tao Wang, Kaihao Zhang 외

Face recognition systems have raised concerns due to their vulnerability to different presentation attacks, and system security has become an increasingly critical concern. Although many face anti-spoofing (FAS) methods …

Adversarial AttackFace Anti-SpoofingFace RecognitionKnowledge Distillation