Unsupervised Domain Adaptation using Lexical Transformations and Label Injection for Twitter Data
Domain adaptation is an important and widely studied problem in natural language processing. A large body of literature tries to solve this problem by adapting models trained on the source domain to the target domain. In this paper, we instead solve this problem from a dataset perspective. We modify the source domain dataset with simple lexical transformations to reduce the domain shift between the source dataset distribution and the target dataset distribution. We find that models trained on the transformed source domain dataset performs significantly better than zero-shot models. Using our proposed transformations to convert standard English to tweets, we reach an unsupervised part-of-speech (POS) tagging accuracy of 92.14% (from 81.54% zero shot accuracy), which is only slightly below the supervised performance of 94.45%. We also use our proposed transformations to synthetically generate tweets and augment the Twitter dataset to achieve state-of-the-art performance for POS tagging.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationPart-Of-Speech TaggingPOSPOS TaggingUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Unsupervised Domain Adaptation Using Approximate Label Matching
Domain adaptation addresses the problem created when training data is generated by a so-called source distribution, but test data is generated by a significantly different target distribution. In this work, we present ap…
Domain AdaptationUnsupervised Domain AdaptationIterative Constrained Back-Translation for Unsupervised Domain Adaptation of Machine Translation
Back-translation has been proven to be effective in unsupervised domain adaptation of neural machine translation (NMT). However, the existing back-translation methods mainly improve domain adaptability by generating in-d…
Domain AdaptationMachine TranslationNMTSentence+3Unsupervised Domain Adaptation with Random Walks on Target Labelings
Unsupervised Domain Adaptation (DA) is used to automatize the task of labeling data: an unlabeled dataset (target) is annotated using a labeled dataset (source) from a related domain. We cast domain adaptation as the pro…
Domain AdaptationUnsupervised Domain AdaptationBayesian Uncertainty Matching for Unsupervised Domain Adaptation
Domain adaptation is an important technique to alleviate performance degradation caused by domain shift, e.g., when training and test data come from different domains. Most existing deep adaptation methods focus on reduc…
Domain AdaptationUnsupervised Domain AdaptationSENTRY: Selective Entropy Optimization via Committee Consistency for Unsupervised Domain Adaptation
Many existing approaches for unsupervised domain adaptation (UDA) focus on adapting under only data distribution shift and offer limited success under additional cross-domain label distribution shift. Recent work based o…
Domain AdaptationPseudo LabelUnsupervised Domain Adaptation