Scalable Cross-lingual Treebank Synthesis for Improved Production Dependency Parsers
We present scalable Universal Dependency (UD) treebank synthesis techniques that exploit advances in language representation modeling which leverage vast amounts of unlabeled general-purpose multilingual text. We introduce a data augmentation technique that uses synthetic treebanks to improve production-grade parsers. The synthetic treebanks are generated using a state-of-the-art biaffine parser adapted with pretrained Transformer models, such as Multilingual BERT (M-BERT). The new parser improves LAS by up to two points on seven languages. The production models{'} LAS performance improves as the augmented treebanks scale in size, surpassing performance of production models trained on originally annotated UD treebanks.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Cross-Lingual Dependency Parsing Using Code-Mixed TreeBank
Treebank translation is a promising method for cross-lingual transfer of syntactic dependency knowledge. The basic idea is to map dependency arcs from a source treebank to its target translation according to word alignme…
Cross-Lingual TransferCross-Lingual Word EmbeddingsDependency ParsingTranslation+1Cross-lingual Universal Dependency Parsing Only from One Monolingual Treebank
Syntactic parsing is a highly linguistic processing task whose parser requires training on treebanks from the expensive human annotation. As it is unlikely to obtain a treebank for every human language, in this work, we …
Cross-Lingual TransferDependency ParsingDomain AdaptationLanguage Modeling+2Multi-source synthetic treebank creation for improved cross-lingual dependency parsing
This paper describes a method of creating synthetic treebanks for cross-lingual dependency parsing using a combination of machine translation (including pivot translation), annotation projection and the spanning tree alg…
Dependency ParsingMachine TranslationSentenceTranslationLyS_ACoruña at SemEval-2022 Task 10: Repurposing Off-the-Shelf Tools for Sentiment Analysis as Semantic Dependency Parsing
This paper addressed the problem of structured sentiment analysis using a bi-affine semantic dependency parser, large pre-trained language models, and publicly available translation models. For the monolingual setup, we …
Dependency ParsingSemantic Dependency ParsingSentiment AnalysisTranslationA Universal Framework for Inductive Transfer Parsing across Multi-typed Treebanks
Various treebanks have been released for dependency parsing. Despite that treebanks may belong to different languages or have different annotation schemes, they contain common syntactic knowledge that is potential to ben…
Dependency ParsingInformation RetrievalMulti-Task Learning