Fine-grained Morphosyntactic Analysis and Generation Tools for More Than One Thousand Languages
Exploiting the broad translation of the Bible into the world{'}s languages, we train and distribute morphosyntactic tools for approximately one thousand languages, vastly outstripping previous distributions of tools devoted to the processing of inflectional morphology. Evaluation of the tools on a subset of available inflectional dictionaries demonstrates strong initial models, supplemented and improved through ensembling and dictionary-based reranking. Likewise, a novel type-to-token based evaluation metric allows us to confirm that models generalize well across rare and common forms alike
Code (0)
등록된 구현이 없습니다.
Tasks
RerankingTranslationSimilar Papers 제목 키워드 기반
TalkTag: Fine-Grained Morphosyntactic Error Annotation for Transcribed Speech
Fine-grained morphosyntactic error annotation is important in clinical and developmental language research, yet it is labour-intensive, expert-dependent, and difficult to scale. We present TalkTag, an LLM-based lightweig…
To Diverge or Not to Diverge: A Morphosyntactic Perspective on Machine Translation vs Human Translation
We conduct a large-scale fine-grained comparative analysis of machine translations (MT) against human translations (HT) through the lens of morphosyntactic divergence. Across three language pairs and two types of diverge…
AttributeDiversityMachine TranslationTranslationJoint Prediction of Morphosyntactic Categories for Fine-Grained Arabic Part-of-Speech Tagging Exploiting Tag Dictionary Information
Part-of-speech (POS) tagging for morphologically rich languages such as Arabic is a challenging problem because of their enormous tag sets. One reason for this is that in the tagging scheme for such languages, a complete…
Multi-Task LearningPart-Of-Speech TaggingPOSPOS Tagging+2COMBO: State-of-the-Art Morphosyntactic Analysis
We introduce COMBO - a fully neural NLP system for accurate part-of-speech tagging, morphological analysis, lemmatisation, and (enhanced) dependency parsing. It predicts categorical morphosyntactic features whilst also e…
Dependency ParsingMorphological AnalysisPart-Of-Speech TaggingModeling Grammatical Hypothesis Testing in Young Learners: A Sequence-Based Learning Analytics Study of Morphosyntactic Reasoning in an Interactive Game
This study investigates grammatical reasoning in primary school learners through a sequence-based learning analytics approach, leveraging fine-grained action sequences from an interactive game targeting morphosyntactic a…