Some Languages Seem Easier to Parse Because Their Treebanks Leak
Cross-language differences in (universal) dependency parsing performance are mostly attributed to treebank size, average sentence length, average dependency length, morphological complexity, and domain differences. We point at a factor not previously discussed: If we abstract away from words and dependency labels, how many graphs in the test data were seen in the training data? We compute graph isomorphisms, and show that, treebank size aside, overlap between training and test graphs explain more of the observed variation than standard explanations such as the above.
Code (0)
등록된 구현이 없습니다.
Tasks
Dependency ParsingSentenceSimilar Papers 제목 키워드 기반
What Kind of Language Is Hard to Language-Model?
How language-agnostic are current state-of-the-art NLP tools? Are there some types of language that are easier to model with current methods? In prior work (Cotterell et al., 2018) we attempted to address this question f…
Language ModelingLanguage ModellingSentenceEvaluating AI-generated code for C++, Fortran, Go, Java, Julia, Matlab, Python, R, and Rust
This study evaluates the capabilities of ChatGPT versions 3.5 and 4 in generating code across a diverse range of programming languages. Our objective is to assess the effectiveness of these AI models for generating scien…
Numerical IntegrationMulti-Model and Crosslingual Dependency Analysis
This paper describes the system of the Team Orange-Deski{\~n}, used for the CoNLL 2017 UD Shared Task in Multilingual Dependency Parsing. We based our approach on an existing open source tool (BistParser), which we modif…
Dependency ParsingmodelWord EmbeddingsInvestigation of Transfer Languages for Parsing Latin: Italic Branch vs. Hellenic Branch
Choosing a transfer language is a crucial step in transfer learning. In much previous research on dependency parsing, related languages have successfully been used. However, when parsing Latin, it has been suggested that…
Dependency ParsingTransfer LearningLearning ASR pathways: A sparse multilingual ASR model
Neural network pruning compresses automatic speech recognition (ASR) models effectively. However, in multilingual ASR, language-agnostic pruning may lead to severe performance drops on some languages because language-agn…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Network Pruningspeech-recognition+2