paper-with-me

Papers

Multilingual Gradient Word-Order Typology from Universal Dependencies

2024-02-02 · Emi Baylor, Esther Ploeger, Johannes Bjerva

While information from the field of linguistic typology has the potential to improve performance on NLP tasks, reliable typological data is a prerequisite. Existing typological databases, including WALS and Grambank, suffer from inconsistencies primarily caused by their categorical format. Furthermore, typological categorisations by definition differ significantly from the continuous nature of phenomena, as found in natural language corpora. In this paper, we introduce a new seed dataset made up of continuous-valued data, rather than categorical data, that can better reflect the variability of language. While this initial dataset focuses on word-order typology, we also present the methodology used to create the dataset, which can be easily adapted to generate data for a broader set of features and languages.

📄 PDF Abstract BibTeX arXiv:2402.01513

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Word Order Typology through Multilingual Word Alignment

2015-07-01 · IJCNLP 2015 7 · Robert {\"O}stling
Dependency ParsingTransfer LearningWord Alignment

A Typologically Grounded Evaluation Framework for Word Order and Morphology Sensitivity in Multilingual Masked LMs

2026-02-28 · Anna Feldman, Libby Barak, Jing Peng arxiv

We introduce a typology-aware diagnostic for multilingual masked language models that tests reliance on word order versus inflectional form. Using Universal Dependencies, we apply inference-time perturbations: full token…

Word-order typology in Multilingual BERT: A case study in subordinate-clause detection

2022-05-24 · NAACL (SIGTYP) 2022 7 · Dmitry Nikolaev, Sebastian Padó

The capabilities and limitations of BERT and similar models are still unclear when it comes to learning syntactic abstractions, in particular across languages. In this paper, we use the task of subordinate-clause detecti…

A Grounded Typology of Word Classes

2024-12-13 · Coleman Haley, Sharon Goldwater, Edoardo Ponti

We propose a grounded approach to meaning in language typology. We treat data from perceptual modalities, such as images, as a language-agnostic representation of meaning. Hence, we can quantify the function--form relati…

Universal Dependencies: A Cross-Linguistic Perspective on Grammar and Lexicon

2016-12-01 · WS 2016 12 · Joakim Nivre

Universal Dependencies is an initiative to develop cross-linguistically consistent grammatical annotation for many languages, with the goal of facilitating multilingual parser development, cross-lingual learning and pars…

Position