paper-with-me

홈 › Papers

Towards Instance-Level Parser Selection for Cross-Lingual Transfer of Dependency Parsers

2020-04-16 · COLING 2020 8 · Robert Litschko, Ivan Vulić, Željko Agić, Goran Glavaš

Current methods of cross-lingual parser transfer focus on predicting the best parser for a low-resource target language globally, that is, "at treebank level". In this work, we propose and argue for a novel cross-lingual transfer paradigm: instance-level parser selection (ILPS), and present a proof-of-concept study focused on instance-level selection in the framework of delexicalized parser transfer. We start from an empirical observation that different source parsers are the best choice for different Universal POS sequences in the target language. We then propose to predict the best parser at the instance level. To this end, we train a supervised regression model, based on the Transformer architecture, to predict parser accuracies for individual POS-sequences. We compare ILPS against two strong single-best parser selection baselines (SBPS): (1) a model that compares POS n-gram distributions between the source and target languages (KL) and (2) a model that selects the source based on the similarity between manually created language vectors encoding syntactic properties of languages (L2V). The results from our extensive evaluation, coupling 42 source parsers and 20 diverse low-resource test languages, show that ILPS outperforms KL and L2V on 13/20 and 14/20 test languages, respectively. Further, we show that by predicting the best parser "at the treebank level" (SBPS), using the aggregation of predictions from our instance-level model, we outperform the same baselines on 17/20 and 16/20 test languages.

📄 PDF Abstract BibTeX arXiv:2004.07642

Code (0)

등록된 구현이 없습니다.

Tasks

Cross-Lingual TransferPOS

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Cross-Lingual Parser Selection for Low-Resource Languages

2017-05-01 · WS 2017 5 · {\v{Z}}eljko Agi{\'c}
Cross-Lingual TransferDependency ParsingTransfer Learning

Cross-lingual Learning of an Open-domain Semantic Parser

2016-12-01 · COLING 2016 12 · Kilian Evang, Johan Bos

We propose a method for learning semantic CCG parsers by projecting annotations via a parallel corpus. The method opens an avenue towards cheaply creating multilingual semantic parsers mapping open-domain text to formal …

Semantic Parsing

Accounting for Language Effect in the Evaluation of Cross-lingual AMR Parsers

2022-10-01 · COLING 2022 10 · Shira Wein, Nathan Schneider

Cross-lingual Abstract Meaning Representation (AMR) parsers are currently evaluated in comparison to gold English AMRs, despite parsing a language other than English, due to the lack of multilingual AMR evaluation metric…

Abstract Meaning RepresentationSentence

Development of a Bengali parser by cross-lingual transfer from Hindi

2016-12-01 · WS 2016 12 · Ayan Das, Agnivo Saha, Sudeshna Sarkar

In recent years there has been a lot of interest in cross-lingual parsing for developing treebanks for languages with small or no annotated treebanks. In this paper, we explore the development of a cross-lingual transfer…

ChunkingCross-Lingual TransferSentence

Isomorphic Transfer of Syntactic Structures in Cross-Lingual NLP

2018-07-01 · ACL 2018 7 · Edoardo Maria Ponti, Roi Reichart, Anna Korhonen, Ivan Vuli{\'c}

The transfer or share of knowledge between languages is a potential solution to resource scarcity in NLP. However, the effectiveness of cross-lingual transfer can be challenged by variation in syntactic structures. Frame…

Cross-Lingual TransferMachine TranslationRepresentation LearningSentence+3