PPT: Parsimonious Parser Transfer for Unsupervised Cross-Lingual Adaptation
Cross-lingual transfer is a leading technique for parsing low-resource languages in the absence of explicit supervision. Simple `direct transfer' of a learned model based on a multilingual input encoding has provided a strong benchmark. This paper presents a method for unsupervised cross-lingual transfer that improves over direct transfer systems by using their output as implicit supervision as part of self-training on unlabelled text in the target language. The method assumes minimal resources and provides maximal flexibility by (a) accepting any pre-trained arc-factored dependency parser; (b) assuming no access to source language data; (c) supporting both projective and non-projective parsing; and (d) supporting multi-source transfer. With English as the source language, we show significant improvements over state-of-the-art transfer models on both distant and nearby languages, despite our conceptually simpler approach. We provide analyses of the choice of source languages for multi-source transfer, and the advantage of non-projective parsing. Our code is available online.
Code (1)
Tasks
ARCCross-Lingual TransferSimilar Papers 제목 키워드 기반
PTST-UoM at SemEval-2021 Task 10: Parsimonious Transfer for Sequence Tagging
This paper describes PTST, a source-free unsupervised domain adaptation technique for sequence tagging, and its application to the SemEval-2021 Task 10 on time expression recognition. PTST is an extension of the cross-li…
Domain AdaptationUnsupervised Domain AdaptationUnsupervised Cross-Lingual Adaptation of Dependency Parsers Using CRF Autoencoders
We consider the task of cross-lingual adaptation of dependency parsers without annotated target corpora and parallel corpora. Previous work either directly applies a discriminative source parser to the target language, i…
Parsing Universal Dependencies without training
We propose UDP, the first training-free parser for Universal Dependencies (UD). Our algorithm is based on PageRank and a small set of head attachment rules. It features two-step decoding to guarantee that function words …
“Wikily” Supervised Neural Translation Tailored to Cross-Lingual Tasks
We present a simple but effective approach for leveraging Wikipedia for neural machine translation as well as cross-lingual tasks of image captioning and dependency parsing without using any direct supervision from exter…
Cross-Lingual TransferCross-Lingual Word EmbeddingsDependency ParsingImage Captioning+3"Wikily" Supervised Neural Translation Tailored to Cross-Lingual Tasks
We present a simple but effective approach for leveraging Wikipedia for neural machine translation as well as cross-lingual tasks of image captioning and dependency parsing without using any direct supervision from exter…
Cross-Lingual TransferCross-Lingual Word EmbeddingsDependency ParsingImage Captioning+3