End-to-end mBERT based Seq2seq Enhanced Dependency Parser with Linguistic Typology knowledge
We describe the NUIG solution for IWPT 2021 Shared Task of Enhanced Dependency (ED) parsing in multiple languages. For this shared task, we propose and evaluate an End-to-end Seq2seq mBERT-based ED parser which predicts the ED-parse tree of a given input sentence as a relative head-position tag-sequence. Our proposed model is a multitasking neural-network which performs five key tasks simultaneously namely UPOS tagging, UFeat tagging, Lemmatization, Dependency-parsing and ED-parsing. Furthermore we utilise the linguistic typology available in the WALS database to improve the ability of our proposed end-to-end parser to transfer across languages. Results show that our proposed Seq2seq ED-parser performs on par with state-of-the-art ED-parser despite having a much simpler de- sign.
Code (0)
등록된 구현이 없습니다.
Tasks
Dependency ParsingLemmatizationPositionSentenceTAGSimilar Papers 제목 키워드 기반
Cross-lingual Constituency Parsing with Linguistic Typology Knowledge
Cross-lingual Transfer learning (CLT) has successfully been applied to the dependency parsing task. This is the first work that evaluates a CLT based approach to the Constituency parsing task. Furthermore, we utilized th…
Constituency ParsingCross-Lingual TransferDependency ParsingTransfer LearningImproving the Performance of UDify with Linguistic Typology Knowledge
UDify is the state-of-the-art language-agnostic dependency parser which is trained on a polyglot corpus of 75 languages. This multilingual modeling enables the model to generalize over unknown/lesser-known languages, thu…
Working Hard or Hardly Working: Challenges of Integrating Typology into Neural Dependency Parsers
This paper explores the task of leveraging typology in the context of cross-lingual dependency parsing. While this linguistic information has shown great promise in pre-neural parsing, results for neural architectures ha…
Dependency ParsingUDapter: Typology-based Language Adapters for Multilingual Dependency Parsing and Sequence Labeling
Recent advances in multilingual language modeling have brought the idea of a truly universal parser closer to reality. However, such models are still not immune to the “curse of multilinguality”: Cross-language interfere…
Dependency ParsingLanguage ModelingLanguage ModellingMorphological Tagging+3UDapter: Language Adaptation for Truly Universal Dependency Parsing
Recent advances in multilingual dependency parsing have brought the idea of a truly universal parser closer to reality. However, cross-language interference and restrained model capacity remain major obstacles. To addres…
Dependency ParsingTransfer Learning