Cross-Lingual Transfer Learning for POS Tagging without Cross-Lingual Resources
Training a POS tagging model with crosslingual transfer learning usually requires linguistic knowledge and resources about the relation between the source language and the target language. In this paper, we introduce a cross-lingual transfer learning model for POS tagging without ancillary resources such as parallel corpora. The proposed cross-lingual model utilizes a common BLSTM that enables knowledge transfer from other languages, and private BLSTMs for language-specific representations. The cross-lingual model is trained with language-adversarial training and bidirectional language modeling as auxiliary objectives to better represent language-general information while not losing the information about a specific target language. Evaluating on POS datasets from 14 languages in the Universal Dependencies corpus, we show that the proposed transfer learning model improves the POS tagging performance of the target languages without exploiting any linguistic knowledge between the source language and the target language.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Lingual TransferLanguage ModelingLanguage ModellingNamed Entity Recognition (NER)Part-Of-Speech TaggingPOSPOS TaggingSlot FillingTransfer LearningWord EmbeddingsSimilar Papers 제목 키워드 기반
Cross-lingual Multi-Level Adversarial Transfer to Enhance Low-Resource Name Tagging
We focus on improving name tagging for low-resource languages using annotations from related languages. Previous studies either directly project annotations from a source language to a target language using cross-lingual…
Cross-Lingual TransferSentenceA language-independent and fully unsupervised approach to lexicon induction and part-of-speech tagging for closely related languages
In this paper, we describe our generic approach for transferring part-of-speech annotations from a resourced language towards an etymologically closely related non-resourced language, without using any bilingual (i.e., p…
Part-Of-Speech TaggingPOSTranslationMake the Best of Cross-lingual Transfer: Evidence from POS Tagging with over 100 Languages
Cross-lingual transfer learning with large multilingual pre-trained models can be an effective approach for low-resource languages with no labeled training data. Existing evaluations of cross-lingual generalisability of …
Cross-Lingual TransferPart-Of-Speech TaggingPOSPOS Tagging+1Make the Best of Cross-lingual Transfer: Evidence from POS Tagging with over 100 Languages
Cross-lingual transfer learning with large multilingual pre-trained models can be an effective approach for low-resource languages with no labeled training data. Existing evaluations of zero-shot cross-lingual generalisa…
Cross-Lingual TransferPart-Of-Speech TaggingPOSPOS Tagging+2Comparative Study of Zero-Shot Cross-Lingual Transfer for Bodo POS and NER Tagging Using Gemini 2.0 Flash Thinking Experimental Model
Named Entity Recognition (NER) and Part-of-Speech (POS) tagging are critical tasks for Natural Language Processing (NLP), yet their availability for low-resource languages (LRLs) like Bodo remains limited. This article p…
Cross-Lingual TransferMachine Translationnamed-entity-recognitionNamed Entity Recognition+8