paper-with-me

홈 › Papers

Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translation

2024-11-18 · Peng Shu, JunHao Chen, Zhengliang Liu, Hui Wang, Zihao Wu, Tianyang Zhong, Yiwei Li, Huaqin Zhao, Hanqi Jiang, Yi Pan, Yifan Zhou, Constance Owl, Xiaoming Zhai, Ninghao Liu, Claudio Saunt, Tianming Liu

Large Language Models (LLMs) have demonstrated remarkable success across a wide range of tasks and domains. However, their performance in low-resource language translation, particularly when translating into these languages, remains underexplored. This gap poses significant challenges, as linguistic barriers hinder the cultural preservation and development of minority communities. To address this issue, this paper introduces a novel retrieval-based method that enhances translation quality for low-resource languages by focusing on key terms, which involves translating keywords and retrieving corresponding examples from existing data. To evaluate the effectiveness of this method, we conducted experiments translating from English into three low-resource languages: Cherokee, a critically endangered indigenous language of North America; Tibetan, a historically and culturally significant language in Asia; and Manchu, a language with few remaining speakers. Our comparison with the zero-shot performance of GPT-4o and LLaMA 3.1 405B, highlights the significant challenges these models face when translating into low-resource languages. In contrast, our retrieval-based method shows promise in improving both word-level accuracy and overall semantic understanding by leveraging existing resources more effectively.

📄 PDF Abstract BibTeX arXiv:2411.11295

Code (0)

등록된 구현이 없습니다.

Tasks

RetrievalTranslation

Methods 이 논문이 사용한 방법론

LLaMA LLaMA is a collection of foundation language models ranging from 7B to 65B parameters. It is based on the transformer architecture with various improvements that were…

Similar Papers 제목 키워드 기반

Advancing oncology with federated learning: transcending boundaries in breast, lung, and prostate cancer. A systematic review

2024-08-08 · Anshu Ankolekar, Sebastian Boie, Maryam Abdollahyan, Emanuela Gadaleta 외

Federated Learning (FL) has emerged as a promising solution to address the limitations of centralised machine learning (ML) in oncology, particularly in overcoming privacy concerns and harnessing the power of diverse, mu…

Federated Learning

Multilingual Topic Classification in X: Dataset and Analysis

2024-10-04 · Dimosthenis Antypas, Asahi Ushio, Francesco Barbieri, Jose Camacho-Collados

In the dynamic realm of social media, diverse topics are discussed daily, transcending linguistic boundaries. However, the complexities of understanding and categorising this content across various languages remain an im…

ClassificationDiversityTopic Classification

Analyzing LLMs' Knowledge Boundary Cognition Across Languages Through the Lens of Internal Representations

2025-04-18 · Chenghao Xiao, Hou Pong Chan, Hao Zhang, Mahani Aljunied 외

While understanding the knowledge boundaries of LLMs is crucial to prevent hallucination, research on knowledge boundaries of LLMs has predominantly focused on English. In this work, we present the first study to analyze…

Hallucination

GraphLLM: Boosting Graph Reasoning Ability of Large Language Model

2023-10-09 · Ziwei Chai, Tianjie Zhang, Liang Wu, Kaiqiao Han 외

The advancement of Large Language Models (LLMs) has remarkably pushed the boundaries towards artificial general intelligence (AGI), with their exceptional ability on understanding diverse types of information, including …

Graph LearningLanguage ModelingLanguage ModellingLarge Language Model

Understanding and Mitigating Overrefusal in LLMs from an Unveiling Perspective of Safety Decision Boundary

2025-05-23 · Licheng Pan, Yongqi Tong, Xin Zhang, Xiaolu Zhang 외

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks, yet they often refuse to answer legitimate queries-a phenomenon known as overrefusal. Overrefusal typically stems from …

Safety Alignment