Automatic Interlinear Glossing for Under-Resourced Languages Leveraging Translations
Interlinear Glossed Text (IGT) is a widely used format for encoding linguistic information in language documentation projects and scholarly papers. Manual production of IGT takes time and requires linguistic expertise. We attempt to address this issue by creating automatic glossing models, using modern multi-source neural models that additionally leverage easy-to-collect translations. We further explore cross-lingual transfer and a simple output length control mechanism, further refining our models. Evaluated on three challenging low-resource scenarios, our approach significantly outperforms a recent, state-of-the-art baseline, particularly improving on overall accuracy as well as lemma and tag recall.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Lingual TransferLEMMATAGSimilar Papers 제목 키워드 기반
Automatic Interlinear Glossing for Otomi language
In linguistics, interlinear glossing is an essential procedure for analyzing the morphology of languages. This type of annotation is useful for language documentation, and it can also provide valuable data for NLP applic…
POSPrompt and circumstance: A word-by-word LLM prompting approach to interlinear glossing for low-resource languages
Partly automated creation of interlinear glossed text (IGT) has the potential to assist in linguistic documentation. We argue that LLMs can make this process more accessible to linguists because of their capacity to foll…
Embedded Translations for Low-resource Automated Glossing
We investigate automatic interlinear glossing in low-resource settings. We augment a hard-attentional neural model with embedded translation information extracted from interlinear glossed text. After encoding these trans…
DecoderTranslationAutomatic interlinear glossing as two-level sequence classification
Can we teach language models to gloss endangered languages?
Interlinear glossed text (IGT) is a popular format in language documentation projects, where each morpheme is labeled with a descriptive annotation. Automating the creation of interlinear glossed text would be desirable …
DescriptiveIn-Context Learning