Multi-task Domain Adaptation for Sequence Tagging
Many domain adaptation approaches rely on learning cross domain shared representations to transfer the knowledge learned in one domain to other domains. Traditional domain adaptation only considers adapting for one task. In this paper, we explore multi-task representation learning under the domain adaptation scenario. We propose a neural network framework that supports domain adaptation for multiple tasks simultaneously, and learns shared representations that better generalize for domain adaptation. We apply the proposed framework to domain adaptation for sequence tagging problems considering two tasks: Chinese word segmentation and named entity recognition. Experiments show that multi-task domain adaptation works better than disjoint domain adaptation for each task, and achieves the state-of-the-art results for both tasks in the social media domain.
Code (0)
등록된 구현이 없습니다.
Tasks
Chinese Word SegmentationDomain Adaptationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Representation LearningSimilar Papers 제목 키워드 기반
PTST-UoM at SemEval-2021 Task 10: Parsimonious Transfer for Sequence Tagging
This paper describes PTST, a source-free unsupervised domain adaptation technique for sequence tagging, and its application to the SemEval-2021 Task 10 on time expression recognition. PTST is an extension of the cross-li…
Domain AdaptationUnsupervised Domain AdaptationSpanAlign: Efficient Sequence Tagging Annotation Projection into Translated Data applied to Cross-Lingual Opinion Mining
Following the increasing performance of neural machine translation systems, the paradigm of using automatically translated data for cross-lingual adaptation is now studied in several applicative domains. The capacity to …
Data AugmentationMachine TranslationOpinion MiningTranslationUnsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond
Cross-lingual adaptation with multilingual pre-trained language models (mPTLMs) mainly consists of two lines of works: zero-shot approach and translation-based approach, which have been studied extensively on the sequenc…
Cross-Lingual TransferTranslationSemEval-2021 Task 10: Source-Free Domain Adaptation for Semantic Processing
This paper presents the Source-Free Domain Adaptation shared task held within SemEval-2021. The aim of the task was to explore adaptation of machine-learning models in the face of data sharing constraints. Specifically, …
Domain AdaptationNegationNegation DetectionSource-Free Domain Adaptation+2PADA: Example-based Prompt Learning for on-the-fly Adaptation to Unseen Domains
Natural Language Processing algorithms have made incredible progress, but they still struggle when applied to out-of-distribution examples. We address a challenging and underexplored version of this domain adaptation pro…
Domain AdaptationLanguage ModellingNatural Language InferencePrompt Learning+3