paper-with-me

홈 › Papers

Pair-based Self-Distillation for Semi-supervised Domain Adaptation

2021-01-01 · Jeongbeen Yoon, Dahyun Kang, Minsu Cho

Semi-supervised domain adaptation (SSDA) is to adapt a learner to a new domain with only a small set of labeled samples when a large labeled dataset is given on a source domain. In this paper, we propose a pair-based SSDA method that adapts a learner to the target domain using self-distillation with sample pairs. Our method composes the sample pair by selecting a teacher sample from a labeled dataset (i.e., source or labeled target) and its student sample from an unlabeled dataset (i.e., unlabeled target), and then minimizes the output discrepancy between the two samples. We assign a reliable student to a teacher using pseudo-labeling and reliability evaluation so that the teacher sample propagates its prediction to the corresponding student sample. When the teacher sample is chosen from the source dataset, it minimizes the discrepancy between the source domain and the target domain. When the teacher sample is selected from the labeled target dataset, it reduces the discrepancy within the target domain. Experimental evaluation on standard benchmarks shows that our method effectively minimizes both the inter-domain and intra-domain discrepancies, thus achieving the state-of-the-art results.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationSemi-supervised Domain Adaptation

Similar Papers 제목 키워드 기반

Semi-supervised Domain Adaptation via Sample-to-Sample Self-Distillation

2021-11-29 · Jeongbeen Yoon, Dahyun Kang, Minsu Cho

Semi-supervised domain adaptation (SSDA) is to adapt a learner to a new domain with only a small set of labeled samples when a large labeled dataset is given on a source domain. In this paper, we propose a pair-based SSD…

Domain AdaptationSemi-supervised Domain Adaptation

Reconstruction-Aware Prior Distillation for Semi-supervised Point Cloud Completion

2022-04-20 · Zhaoxin Fan, Yulin He, Zhicheng Wang, Kejian Wu 외

Real-world sensors often produce incomplete, irregular, and noisy point clouds, making point cloud completion increasingly important. However, most existing completion methods rely on large paired datasets for training, …

Point Cloud Completion

Iterative Graph Self-Distillation

2020-10-23 · HANLIN ZHANG, Shuai Lin, Weiyang Liu, Pan Zhou 외

Recently, there has been increasing interest in the challenge of how to discriminatively vectorize graphs. To address this, we propose a method called Iterative Graph Self-Distillation (IGSD) which learns graph-level rep…

Contrastive LearningGraph LearningKnowledge Distillation

Modality-Aware Contrastive Instance Learning with Self-Distillation for Weakly-Supervised Audio-Visual Violence Detection

2022-07-12 · Jiashuo Yu, Jinyu Liu, Ying Cheng, Rui Feng 외

Weakly-supervised audio-visual violence detection aims to distinguish snippets containing multimodal violence events with video-level labels. Many prior works perform audio-visual integration and interaction in an early …

Anomaly Detection In Surveillance Videosaudio-visual learningMultiple Instance Learning

Unpaired Learning for Deep Image Deraining With Rain Direction Regularizer

2021-01-01 · ICCV 2021 10 · Yang Liu, Ziyu Yue, Jinshan Pan, Zhixun Su

We present a simple yet effective unpaired learning based image rain removal method from an unpaired set of synthetic images and real rainy images by exploring the properties of rain maps. The proposed algorithm main…

Knowledge DistillationRain Removal