paper-with-me

홈 › Papers

Narrowing the Gap between Zero- and Few-shot Machine Translation by Matching Styles

2023-11-04 · Weiting Tan, Haoran Xu, Lingfeng Shen, Shuyue Stella Li, Kenton Murray, Philipp Koehn, Benjamin Van Durme, Yunmo Chen

Large language models trained primarily in a monolingual setting have demonstrated their ability to generalize to machine translation using zero- and few-shot examples with in-context learning. However, even though zero-shot translations are relatively good, there remains a discernible gap comparing their performance with the few-shot setting. In this paper, we investigate the factors contributing to this gap and find that this gap can largely be closed (for about 70%) by matching the writing styles of the target corpus. Additionally, we explore potential approaches to enhance zero-shot baselines without the need for parallel demonstration examples, providing valuable insights into how these methods contribute to improving translation metrics.

📄 PDF Abstract BibTeX arXiv:2311.02310

Code (0)

등록된 구현이 없습니다.

Tasks

In-Context LearningMachine TranslationTranslation

Similar Papers 제목 키워드 기반

Zero-shot translation among Indian languages

2020-12-01 · loresmt (AACL) 2020 12 · Rudali Huidrom, Yves Lepage

Standard neural machine translation (NMT) allows a model to perform translation between a pair of languages. Multilingual neural machine translation (NMT), on the other hand, allows a model to perform translation between…

Machine TranslationNMTSentenceTranslation

Rethinking Zero-shot Neural Machine Translation: From a Perspective of Latent Variables

2021-09-10 · Findings (EMNLP) 2021 11 · Weizhi Wang, Zhirui Zhang, Yichao Du, Boxing Chen 외

Zero-shot translation, directly translating between language pairs unseen in training, is a promising capability of multilingual neural machine translation (NMT). However, it usually suffers from capturing spurious corre…

DenoisingMachine TranslationNMTTranslation

Zero-Shot Dual Machine Translation

2018-05-25 · Lierni Sestorain, Massimiliano Ciaramita, Christian Buck, Thomas Hofmann

Neural Machine Translation (NMT) systems rely on large amounts of parallel data. This is a major challenge for low-resource languages. Building on recent work on unsupervised and semi-supervised methods, we present an ap…

Machine TranslationNMTReinforcement LearningTranslation

T-Modules: Translation Modules for Zero-Shot Cross-Modal Machine Translation

2022-05-24 · Paul-Ambroise Duquenne, Hongyu Gong, Benoît Sagot, Holger Schwenk

We present a new approach to perform zero-shot cross-modal transfer between speech and text for translation tasks. Multilingual speech and text are encoded in a joint fixed-size representation space. Then, we compare dif…

DecoderMachine Translationtext-to-speechText to Speech+2

Subword Segmentation and a Single Bridge Language Affect Zero-Shot Neural Machine Translation

2020-11-03 · WMT (EMNLP) 2020 11 · Annette Rios, Mathias Müller, Rico Sennrich

Zero-shot neural machine translation is an attractive goal because of the high cost of obtaining data and building translation systems for new translation directions. However, previous papers have reported mixed success …

Machine TranslationSegmentationTAGTranslation