paper-with-me

홈 › Papers

Overcoming Data Scarcity in Generative Language Modelling for Low-Resource Languages: A Systematic Review

2025-05-07 · Josh McGiff, Nikola S. Nikolov

Generative language modelling has surged in popularity with the emergence of services such as ChatGPT and Google Gemini. While these models have demonstrated transformative potential in productivity and communication, they overwhelmingly cater to high-resource languages like English. This has amplified concerns over linguistic inequality in natural language processing (NLP). This paper presents the first systematic review focused specifically on strategies to address data scarcity in generative language modelling for low-resource languages (LRL). Drawing from 54 studies, we identify, categorise and evaluate technical approaches, including monolingual data augmentation, back-translation, multilingual training, and prompt engineering, across generative tasks. We also analyse trends in architecture choices, language family representation, and evaluation methods. Our findings highlight a strong reliance on transformer-based models, a concentration on a small subset of LRLs, and a lack of consistent evaluation across studies. We conclude with recommendations for extending these methods to a wider range of LRLs and outline open challenges in building equitable generative language systems. Ultimately, this review aims to support researchers and developers in building inclusive AI tools for underrepresented languages, a necessary step toward empowering LRL speakers and the preservation of linguistic diversity in a world increasingly shaped by large-scale language technologies.

📄 PDF Abstract BibTeX arXiv:2505.04531

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationLanguage ModellingPrompt Engineering

Similar Papers 제목 키워드 기반

Towards Overcoming Data Scarcity in Nuclear Energy: A Study on Critical Heat Flux with Physics-consistent Conditional Diffusion Model

2025-11-20 · Farah Alsafadi, Alexandra Akins, Xu Wu arxiv

Deep generative modeling provides a powerful pathway to overcome data scarcity in energy-related applications where experimental data are often limited, costly, or difficult to obtain. By learning the underlying probabil…

Synthetic Data Generation

Normative Diffusion Autoencoders: Application to Amyotrophic Lateral Sclerosis

2024-07-19 · Ayodeji Ijishakin, Adamos Hadjasavilou, Ahmed Abdulaal, Nina Montana-Brown 외

Predicting survival in Amyotrophic Lateral Sclerosis (ALS) is a challenging task. Magnetic resonance imaging (MRI) data provide in vivo insight into brain health, but the low prevalence of the condition and resultant dat…

Survival Prediction

The Annotation Scarcity Paradox in Low-Resource NLP Evaluation: A Decade of Acceleration and Emerging Constraints

2026-05-18 · Vukosi Marivate arxiv

Over the past decade, low-resource natural language processing (NLP) has experienced explosive growth, propelled by cross-lingual transfer, massively multilingual models, and the rapid proliferation of benchmarks. Yet th…

Cross-Lingual TransferData AugmentationActive Learning

VECT-GAN: A variationally encoded generative model for overcoming data scarcity in pharmaceutical science

2025-01-15 · Youssef Abdalla, Marrisa Taub, Eleanor Hilton, Priya Akkaraju 외

Data scarcity in pharmaceutical research has led to reliance on labour-intensive trial-and-error approaches for development rather than data-driven methods. While Machine Learning offers a solution, existing datasets are…

Generative Adversarial NetworkKnowledge Distillation

Language Models for German Text Simplification: Overcoming Parallel Data Scarcity through Style-specific Pre-training

2023-05-22 · Miriam Anschütz, Joshua Oehms, Thomas Wimmer, Bartłomiej Jezierski 외

Automatic text simplification systems help to reduce textual information barriers on the internet. However, for languages other than English, only few parallel data to train these systems exists. We propose a two-step ap…

Text Simplification