paper-with-me

홈 › Papers

Vashantor: A Large-scale Multilingual Benchmark Dataset for Automated Translation of Bangla Regional Dialects to Bangla Language

2023-11-18 · Fatema Tuj Johora Faria, Mukaffi Bin Moin, Ahmed Al Wase, Mehidi Ahmmed, Md. Rabius Sani, Tashreef Muhammad

The Bangla linguistic variety is a fascinating mix of regional dialects that adds to the cultural diversity of the Bangla-speaking community. Despite extensive study into translating Bangla to English, English to Bangla, and Banglish to Bangla in the past, there has been a noticeable gap in translating Bangla regional dialects into standard Bangla. In this study, we set out to fill this gap by creating a collection of 32,500 sentences, encompassing Bangla, Banglish, and English, representing five regional Bangla dialects. Our aim is to translate these regional dialects into standard Bangla and detect regions accurately. To achieve this, we proposed models known as mT5 and BanglaT5 for translating regional dialects into standard Bangla. Additionally, we employed mBERT and Bangla-bert-base to determine the specific regions from where these dialects originated. Our experimental results showed the highest BLEU score of 69.06 for Mymensingh regional dialects and the lowest BLEU score of 36.75 for Chittagong regional dialects. We also observed the lowest average word error rate of 0.1548 for Mymensingh regional dialects and the highest of 0.3385 for Chittagong regional dialects. For region detection, we achieved an accuracy of 85.86% for Bangla-bert-base and 84.36% for mBERT. This is the first large-scale investigation of Bangla regional dialects to Bangla machine translation. We believe our findings will not only pave the way for future work on Bangla regional dialects to Bangla machine translation, but will also be useful in solving similar language-related challenges in low-resource language conditions.

📄 PDF Abstract BibTeX arXiv:2311.11142

Code (1)

Mukaffi28/Vashantor-A-Large-scale-Multilingual-Benchmark-Dataset 공식 구현 pytorch

Tasks

Machine TranslationTranslation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Residual Connection 설명 없음
Inverse Square Root Schedule Inverse Square Root is a learning rate schedule 1 / $\sqrt{\max\left(n, k\right)}$ where $n$ is the current training iteration and $k$ is the number of warm-up steps. This…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Poly-FEVER: A Multilingual Fact Verification Benchmark for Hallucination Detection in Large Language Models

2025-03-19 · Hanzhi Zhang, Sumera Anjum, Heng Fan, Weijian Zheng 외

Hallucinations in generative AI, particularly in Large Language Models (LLMs), pose a significant challenge to the reliability of multilingual applications. Existing benchmarks for hallucination detection focus primarily…

Fact CheckingFact VerificationHallucinationMultilingual NLP

P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs

2024-11-14 · Yidan Zhang, Yu Wan, Boyi Deng, Baosong Yang 외

Recent advancements in large language models (LLMs) showcase varied multilingual capabilities across tasks like translation, code generation, and reasoning. Previous assessments often limited their scope to fundamental n…

Code GenerationTransfer Learning

EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Models

2024-09-26 · Shaoxiong Ji, Zihao Li, Indraneil Paul, Jaakko Paavola 외

In this work, we introduce EMMA-500, a large-scale multilingual language model continue-trained on texts across 546 languages designed for enhanced multilingual performance, focusing on improving language coverage for lo…

Cross-Lingual TransferLanguage ModelingLanguage Modelling

YouTube-SL-25: A Large-Scale, Open-Domain Multilingual Sign Language Parallel Corpus

2024-07-15 · Garrett Tanzer, Biao Zhang

Even for better-studied sign languages like American Sign Language (ASL), data is the bottleneck for machine learning research. The situation is worse yet for the many other sign languages used by Deaf/Hard of Hearing co…

Language Models are Multilingual Chain-of-Thought Reasoners

2022-10-06 · Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang 외

We evaluate the reasoning abilities of large language models in multilingual settings. We introduce the Multilingual Grade School Math (MGSM) benchmark, by manually translating 250 grade-school math problems from the GSM…

GSM8KMath