paper-with-me

홈 › Papers

Decomposed Prompting for Machine Translation Between Related Languages using Large Language Models

2023-05-22 · Ratish Puduppully, Anoop Kunchukuttan, Raj Dabre, Ai Ti Aw, Nancy F. Chen

This study investigates machine translation between related languages i.e., languages within the same family that share linguistic characteristics such as word order and lexical similarity. Machine translation through few-shot prompting leverages a small set of translation pair examples to generate translations for test sentences. This procedure requires the model to learn how to generate translations while simultaneously ensuring that token ordering is maintained to produce a fluent and accurate translation. We propose that for related languages, the task of machine translation can be simplified by leveraging the monotonic alignment characteristic of such languages. We introduce DecoMT, a novel approach of few-shot prompting that decomposes the translation process into a sequence of word chunk translations. Through automatic and human evaluation conducted on multiple related language pairs across various language families, we demonstrate that our proposed approach of decomposed prompting surpasses multiple established few-shot baseline approaches. For example, DecoMT outperforms the strong few-shot prompting BLOOM model with an average improvement of 8 chrF++ scores across the examined languages.

📄 PDF Abstract BibTeX arXiv:2305.13085

Code (1)

ratishsp/decomt 공식 구현 pytorch

Tasks

Machine TranslationTranslation

Methods 이 논문이 사용한 방법론

Test 설명 없음
BLOOM BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages…

Similar Papers 제목 키워드 기반

Adaptive Few-shot Prompting for Machine Translation with Pre-trained Language Models

2025-01-03 · Lei Tang, Jinghui Qin, Wenxuan Ye, Hao Tan 외

Recently, Large language models (LLMs) with in-context learning have demonstrated remarkable potential in handling neural machine translation. However, existing evidence shows that LLMs are prompt-sensitive and it is sub…

In-Context LearningMachine TranslationRetrievalTranslation

Decomposed Prompting to Answer Questions on a Course Discussion Board

2024-07-30 · Brandon Jaipersaud, Paul Zhang, Jimmy Ba, Andrew Petersen 외

We propose and evaluate a question-answering system that uses decomposed prompting to classify and answer student questions on a course discussion board. Our system uses a large language model (LLM) to classify questions…

Language ModelingLanguage ModellingLarge Language ModelQuestion Answering

Enriching Phrase Tables for Statistical Machine Translation Using Mixed Embeddings

2016-12-01 · COLING 2016 12 · Peyman Passban, Qun Liu, Andy Way

The phrase table is considered to be the main bilingual resource for the phrase-based statistical machine translation (PBSMT) model. During translation, a source sentence is decomposed into several phrases. The best matc…

DecoderDocument ClassificationMachine TranslationSentence+2

Neural Machine Translation of Logographic Language Using Sub-character Level Information

2018-10-01 · WS 2018 10 · Longtu Zhang, Mamoru Komachi

Recent neural machine translation (NMT) systems have been greatly improved by encoder-decoder models with attention mechanisms and sub-word units. However, important differences between languages with logographic and alp…

DecoderMachine TranslationNMTTranslation+1

Neural Machine Translation of Logographic Languages Using Sub-character Level Information

2018-09-07 · Longtu Zhang, Mamoru Komachi

Recent neural machine translation (NMT) systems have been greatly improved by encoder-decoder models with attention mechanisms and sub-word units. However, important differences between languages with logographic and alp…

DecoderMachine TranslationNMTTranslation