paper-with-me

홈 › Papers

Oral to Web: Digitizing 'Zero Resource'Languages of Bangladesh

2026-03-05 · Mohammad Mamun Or Rashid arxiv

We present the Multilingual Cloud Corpus, the first national-scale, parallel, multimodal linguistic dataset of Bangladesh's ethnic and indigenous languages. Despite being home to approximately 40 minority languages spanning four language families, Bangladesh has lacked a systematic, cross-family digital corpus for these predominantly oral, computationally "zero resource" varieties, 14 of which are classified as endangered. Our corpus comprises 85792 structured textual entries, each containing a Bengali stimulus text, an English translation, and an IPA transcription, together with approximately 107 hours of transcribed audio recordings, covering 42 language varieties from the Tibeto-Burman, Indo-European, Austro-Asiatic, and Dravidian families, plus two genetically unclassified languages. The data were collected through systematic fieldwork over 90 days across nine districts of Bangladesh, involving 16 data collectors, 77 speakers, and 43 validators, following a predefined elicitation template of 2224 unique items organized at three levels of linguistic granularity: isolated lexical items (475 words across 22 semantic domains), grammatical constructions (887 sentences across 21 categories including verbal conjugation paradigms), and directed speech (862 prompts across 46 conversational scenarios). Post-field processing included IPA transcription by 10 linguists with independent adjudication by 6 reviewers. The complete dataset is publicly accessible through the Multilingual Cloud platform (multiling.cloud), providing searchable access to annotated audio and textual data for all documented varieties. We describe the corpus design, fieldwork methodology, dataset structure, and per-language coverage, and discuss implications for endangered language documentation, low-resource NLP, and digital preservation in linguistically diverse developing countries.

📄 PDF Abstract BibTeX arXiv:2603.05272

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DriveThru: a Document Extraction Platform and Benchmark Datasets for Indonesian Local Language Archives

2024-11-14 · Mohammad Rifqi Farhansyah, Muhammad Zuhdi Fikri Johari, Afinzaki Amiral, Ayu Purwarianti 외

Indonesia is one of the most diverse countries linguistically. However, despite this linguistic diversity, Indonesian languages remain underrepresented in Natural Language Processing (NLP) research and technologies. In t…

Optical Character RecognitionOptical Character Recognition (OCR)

EfficientOCR: An Extensible, Open-Source Package for Efficiently Digitizing World Knowledge

2023-10-16 · Tom Bryan, Jacob Carlson, Abhishek Arora, Melissa Dell

Billions of public domain documents remain trapped in hard copy or lack an accurate digitization. Modern natural language processing methods cannot be used to index, retrieve, and summarize their texts; conduct computati…

Image RetrievalLanguage ModelingLanguage ModellingOptical Character Recognition+2

Can LLMs Follow the Pulse of a Crisis? Evaluating Crisis Sentiment in Bangladesh's July Uprising

2026-09-15 · Md. Samiul Alim, Mahir Shahriar Tamim, Tanvir Ahmed Khan, Sharjil Khan 외 arxiv

Crisis sentiment analysis is especially challenging for low-resource languages such as Bangla, where language, context, and public reaction shift rapidly. We introduce UNRESTSENT200K, a Bangla crisis sentiment dataset wi…

Sentiment Analysis

Endangered Data for Endangered Languages: Digitizing Print dictionaries

2017-03-01 · WS 2017 3 · Michael Maxwell, Aric Bills
Optical Character Recognition (OCR)

Improving the previous state-of-the-art Frisian ASR by fine-tuning XLS-R

2023-03-31 · - 2023 3 · Dragoș Alexandru Bălan, Golshid Shekoufandeh

Automatic Speech Recognition (ASR), a system that converts human speech to text, has a major role in digitizing human communication. Despite their significance, most of these systems are designed for higher-resourced lan…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition+1