paper-with-me

Papers

Automatic Readability Assessment for Closely Related Languages

2023-05-22 · Joseph Marvin Imperial, Ekaterina Kochmar

In recent years, the main focus of research on automatic readability assessment (ARA) has shifted towards using expensive deep learning-based methods with the primary goal of increasing models' accuracy. This, however, is rarely applicable for low-resource languages where traditional handcrafted features are still widely used due to the lack of existing NLP tools to extract deeper linguistic representations. In this work, we take a step back from the technical component and focus on how linguistic aspects such as mutual intelligibility or degree of language relatedness can improve ARA in a low-resource setting. We collect short stories written in three languages in the Philippines-Tagalog, Bikol, and Cebuano-to train readability assessment models and explore the interaction of data and features in various cross-lingual setups. Our results show that the inclusion of CrossNGO, a novel specialized feature exploiting n-gram overlap applied to languages with high mutual intelligibility, significantly improves the performance of ARA models compared to the use of off-the-shelf large multilingual language models alone. Consequently, when both linguistic representations are combined, we achieve state-of-the-art results for Tagalog and Cebuano, and baseline scores for ARA in Bikol.

📄 PDF Abstract BibTeX arXiv:2305.13478

Code (1)

imperialite/ara-close-lang 공식 구현

Similar Papers 제목 키워드 기반

Multiattentive Recurrent Neural Network Architecture for Multilingual Readability Assessment

2019-03-01 · TACL 2019 3 · Ion Madrazo Azpiazu, Maria Soledad Pera

We present a multiattentive recurrent neural network architecture for automatic multilingual readability assessment. This architecture considers raw words as its main input, but internally captures text structure and inf…

BERT Embeddings for Automatic Readability Assessment

2021-06-15 · RANLP 2021 9 · Joseph Marvin Imperial

Automatic readability assessment (ARA) is the task of evaluating the level of ease or difficulty of text documents for a target audience. For researchers, one of the many open problems in the field is to make such models…

Text Classification

Zero-shot Large Language Models for Automatic Readability Assessment

2026-04-27 · Riley Grossman, Yi Chen arxiv

Unsupervised automatic readability assessment (ARA) methods have important practical and research applications (e.g., ensuring medical or educational materials are suitable for their target audiences). In this paper, we …

A Computational Model for the Assessment of Mutual Intelligibility Among Closely Related Languages

2024-02-05 · Jessica Nieder, Johann-Mattis List

Closely related languages show linguistic similarities that allow speakers of one language to understand speakers of another language without having actively learned it. Mutual intelligibility varies in degree and is typ…

BasahaCorpus: An Expanded Linguistic Resource for Readability Assessment in Central Philippine Languages

2023-10-17 · Joseph Marvin Imperial, Ekaterina Kochmar

Current research on automatic readability assessment (ARA) has focused on improving the performance of models in high-resource languages such as English. In this work, we introduce and release BasahaCorpus as part of an …