Cross-lingual Dependency Parsing with Unlabeled Auxiliary Languages
Cross-lingual transfer learning has become an important weapon to battle the unavailability of annotated resources for low-resource languages. One of the fundamental techniques to transfer across languages is learning \emph{language-agnostic} representations, in the form of word embeddings or contextual encodings. In this work, we propose to leverage unannotated sentences from auxiliary languages to help learning language-agnostic representations. Specifically, we explore adversarial training for learning contextual encoders that produce invariant representations across languages to facilitate cross-lingual transfer. We conduct experiments on cross-lingual dependency parsing where we train a dependency parser on a source language and transfer it to a wide range of target languages. Experiments on 28 target languages demonstrate that adversarial training significantly improves the overall transfer performances under several different settings. We conduct a careful analysis to evaluate the language-agnostic representations resulted from adversarial training.
Code (1)
Tasks
Cross-Lingual TransferDependency ParsingTransfer LearningWord EmbeddingsSimilar Papers 제목 키워드 기반
Cross-Lingual Dependency Parsing via Self-Training
Recent advances of multilingual word representations weaken the input divergences across languages, making cross-lingual transfer similar to the monolingual cross-domain and semi-supervised settings. Thus self-training, …
Cross-Lingual POS TaggingCross-Lingual TransferDependency ParsingPOS+1Cross-lingual Universal Dependency Parsing Only from One Monolingual Treebank
Syntactic parsing is a highly linguistic processing task whose parser requires training on treebanks from the expensive human annotation. As it is unlikely to obtain a treebank for every human language, in this work, we …
Cross-Lingual TransferDependency ParsingDomain AdaptationLanguage Modeling+2Substructure Distribution Projection for Zero-Shot Cross-Lingual Dependency Parsing
We present substructure distribution projection (SubDP), a technique that projects a distribution over structures in one domain to another, by projecting substructure distributions separately. Models for the target domai…
ARCDependency ParsingSubstructure Distribution Projection for Zero-Shot Cross-Lingual Dependency Parsing
We present substructure distribution projection (SubDP), a technique that projects a distribution over structures in one domain to another, by projecting substructure distributions separately. Models for the target domai…
ARCDependency ParsingMultilingual Lexicalized Constituency Parsing with Word-Level Auxiliary Tasks
We introduce a constituency parser based on a bi-LSTM encoder adapted from recent work (Cross and Huang, 2016b; Kiperwasser and Goldberg, 2016), which can incorporate a lower level character biLSTM (Ballesteros et al., 2…
Constituency ParsingMorphological AnalysisMorphological TaggingPOS