Loss-based Sequential Learning for Active Domain Adaptation
Active domain adaptation (ADA) studies have mainly addressed query selection while following existing domain adaptation strategies. However, we argue that it is critical to consider not only query selection criteria but also domain adaptation strategies designed for ADA scenarios. This paper introduces sequential learning considering both domain type (source/target) or labelness (labeled/unlabeled). We first train our model only on labeled target samples obtained by loss-based query selection. When loss-based query selection is applied under domain shift, unuseful high-loss samples gradually increase, and the labeled-sample diversity becomes low. To solve these, we fully utilize pseudo labels of the unlabeled target domain by leveraging loss prediction. We further encourage pseudo labels to have low self-entropy and diverse class distributions. Our model significantly outperforms previous methods as well as baseline models in various benchmark datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityDomain AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adversarial Domain Adaptation Using Artificial Titles for Abstractive Title Generation
A common issue in training a deep learning, abstractive summarization model is lack of a large set of training summaries. This paper examines techniques for adapting from a labeled source domain to an unlabeled target do…
Abstractive Text SummarizationArticlesDecoderDomain Adaptation+1Co-training partial domain adaptation networks for industrial Fault Diagnosis
The partial domain adaptation (PDA) challenge is a prevalent issue in industrial fault diagnosis. Drawing inspiration from traditional classification settings where such partial challenge is not a concern, we propose a n…
Domain AdaptationFault DiagnosisPartial Domain AdaptationActive Multi-Kernel Domain Adaptation for Hyperspectral Image Classification
Recent years have witnessed the quick progress of the hyperspectral images (HSI) classification. Most of existing studies either heavily rely on the expensive label information using the supervised learning or can hardly…
Active LearningClassificationDomain AdaptationGeneral Classification+3Learning What is Worth Learning: Active and Sequential Domain Adaptation for Multi-modal Gross Tumor Volume Segmentation
Accurate gross tumor volume segmentation on multi-modal medical data is critical for radiotherapy planning in nasopharyngeal carcinoma and glioblastoma. Recent advances in deep neural networks have brought promising resu…
Medical Image SegmentationDomain AdaptationActive LearningActive Long Term Memory Networks
Continual Learning in artificial neural networks suffers from interference and forgetting when different tasks are learned sequentially. This paper introduces the Active Long Term Memory Networks (A-LTM), a model of sequ…
Continual LearningDomain Adaptation