Cross-Dialect Sentence Transformation: A Comparative Analysis of Language Models for Adapting Sentences to British English
This study explores linguistic distinctions among American, Indian, and Irish English dialects and assesses various Language Models (LLMs) in their ability to generate British English translations from these dialects. Using cosine similarity analysis, the study measures the linguistic proximity between original British English translations and those produced by LLMs for each dialect. The findings reveal that Indian and Irish English translations maintain notably high similarity scores, suggesting strong linguistic alignment with British English. In contrast, American English exhibits slightly lower similarity, reflecting its distinct linguistic traits. Additionally, the choice of LLM significantly impacts translation quality, with Llama-2-70b consistently demonstrating superior performance. The study underscores the importance of selecting the right model for dialect translation, emphasizing the role of linguistic expertise and contextual understanding in achieving accurate translations.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Comparative Analysis of Retrieval-Augmented Generation Techniques for Bengali Standard-to-Dialect Machine Translation Using LLMs
Translating from a standard language to its regional dialects is a significant NLP challenge due to scarce data and linguistic variation, a problem prominent in the Bengali language. This paper proposes and compares two …
Machine TranslationEgyBERT: A Large Language Model Pretrained on Egyptian Dialect Corpora
This study presents EgyBERT, an Arabic language model pretrained on 10.4 GB of Egyptian dialectal texts. We evaluated EgyBERT's performance by comparing it with five other multidialect Arabic language models across 10 ev…
Language ModelingLanguage ModellingLarge Language ModelExploring Bengali Religious Dialect Biases in Large Language Models with Evaluation Perspectives
While Large Language Models (LLM) have created a massive technological impact in the past decade, allowing for human-enabled applications, they can produce output that contains stereotypes and biases, especially when usi…
FairnessA Spelling Correction Corpus for Multiple Arabic Dialects
Arabic dialects are the non-standard varieties of Arabic commonly spoken {--} and increasingly written on social media {--} across the Arab world. Arabic dialects do not have standard orthographies, a challenge for natur…
Spelling CorrectionText NormalizationFine-Grained Arabic Dialect Identification
Previous work on the problem of Arabic Dialect Identification typically targeted coarse-grained five dialect classes plus Standard Arabic (6-way classification). This paper presents the first results on a fine-grained di…
ClassificationDialect IdentificationGeneral ClassificationMachine Translation+1