On the Choice of Auxiliary Languages for Improved Sequence Tagging
Recent work showed that embeddings from related languages can improve the performance of sequence tagging, even for monolingual models. In this analysis paper, we investigate whether the best auxiliary language can be predicted based on language distances and show that the most related language is not always the best auxiliary language. Further, we show that attention-based meta-embeddings can effectively combine pre-trained embeddings from different languages for sequence tagging and set new state-of-the-art results for part-of-speech tagging in five languages.
Code (0)
등록된 구현이 없습니다.
Tasks
Part-Of-Speech TaggingSimilar Papers 제목 키워드 기반
Multilingual Part-of-Speech Tagging with Bidirectional Long Short-Term Memory Models and Auxiliary Loss
Bidirectional long short-term memory (bi-LSTM) networks have recently proven successful for various NLP sequence modeling tasks, but little is known about their reliance to input representations, target languages, data s…
Part-Of-Speech TaggingPOSPOS TaggingImproving part-of-speech tagging via multi-task learning and character-level word representations
In this paper, we explore the ways to improve POS-tagging using various types of auxiliary losses and different word representations. As a baseline, we utilized a BiLSTM tagger, which is able to achieve state-of-the-art …
Multi-Task LearningPart-Of-Speech TaggingPOSPOS TaggingCharacter-level Supervision for Low-resource POS Tagging
Neural part-of-speech (POS) taggers are known to not perform well with little training data. As a step towards overcoming this problem, we present an architecture for learning more robust neural POS taggers by jointly tr…
Feature EngineeringLEMMALemmatizationMulti-Task Learning+2Exploring transfer learning for Deep NLP systems on rarely annotated languages
Natural language processing (NLP) has experienced rapid advancements with the rise of deep learning, significantly outperforming traditional rule-based methods. By capturing hidden patterns and underlying structures with…
Deep LearningPart-Of-Speech TaggingPOSPOS Tagging+2Parallel Algorithms for Unsupervised Tagging
We propose a new method for unsupervised tagging that finds minimal models which are then further improved by Expectation Maximization training. In contrast to previous approaches that rely on manually specified and mult…
Part-Of-Speech Tagging