Active Online Domain Adaptation
Online machine learning systems need to adapt to domain shifts. Meanwhile, acquiring label at every timestep is expensive. We propose a surprisingly simple algorithm that adaptively balances its regret and its number of label queries in settings where the data streams are from a mixture of hidden domains. For online linear regression with oblivious adversaries, we provide a tight tradeoff that depends on the durations and dimensionalities of the hidden domains. Our algorithm can adaptively deal with interleaving spans of inputs from different domains. We also generalize our results to non-linear regression for hypothesis classes with bounded eluder dimension and adaptive adversaries. Experiments on synthetic and realistic datasets demonstrate that our algorithm achieves lower regret than uniform queries and greedy queries with equal labeling budget.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationOnline Domain AdaptationregressionSimilar Papers 제목 키워드 기반
ODES: Domain Adaptation with Expert Guidance for Online Medical Image Segmentation
Unsupervised domain adaptive segmentation typically relies on self-training using pseudo labels predicted by a pre-trained network on an unlabeled target dataset. However, the noisy nature of such pseudo-labels presents …
Active LearningDomain AdaptationFederated LearningImage Segmentation+4Online Active Learning for Cost Sensitive Domain Adaptation
A User-Study on Online Adaptation of Neural Machine Translation to Human Post-Edits
The advantages of neural machine translation (NMT) have been extensively validated for offline translation of several language pairs for different domains of spoken and written language. However, research on interactive …
Machine TranslationNMTTranslationOnline Continual Adaptation with Active Self-Training
Models trained with offline data often suffer from continual distribution shifts and expensive labeling in changing environments. This calls for a new online learning paradigm where the learner can continually adapt to c…
Large-scale ASR Domain Adaptation using Self- and Semi-supervised Learning
Self- and semi-supervised learning methods have been actively investigated to reduce labeled training data or enhance the model performance. However, the approach mostly focus on in-domain performance for public datasets…
Domain Adaptation