paper-with-me

Papers

Mixup Decoding for Diverse Machine Translation

2021-09-08 · Findings (EMNLP) 2021 11 · Jicheng Li, Pengzhi Gao, Xuanfu Wu, Yang Feng, Zhongjun He, Hua Wu, Haifeng Wang

Diverse machine translation aims at generating various target language translations for a given source language sentence. Leveraging the linear relationship in the sentence latent space introduced by the mixup training, we propose a novel method, MixDiversity, to generate different translations for the input sentence by linearly interpolating it with different sentence pairs sampled from the training corpus when decoding. To further improve the faithfulness and diversity of the translations, we propose two simple but effective approaches to select diverse sentence pairs in the training corpus and adjust the interpolation weight for each pair correspondingly. Moreover, by controlling the interpolation weight, our method can achieve the trade-off between faithfulness and diversity without any additional training, which is required in most of the previous methods. Experiments on WMT'16 en-ro, WMT'14 en-de, and WMT'17 zh-en are conducted to show that our method substantially outperforms all previous diverse machine translation methods.

📄 PDF Abstract BibTeX arXiv:2109.03402

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityMachine TranslationSentenceTranslation

Methods 이 논문이 사용한 방법론

Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…

Similar Papers 제목 키워드 기반

A Simple, Fast Diverse Decoding Algorithm for Neural Generation

2016-11-25 · Jiwei Li, Will Monroe, Dan Jurafsky

In this paper, we propose a simple, fast decoding algorithm that fosters diversity in neural generation. The algorithm modifies the standard beam search algorithm by adding an inter-sibling ranking penalty, favoring choo…

Abstractive Text SummarizationDiversityMachine TranslationReinforcement Learning+4

Multi-agent Learning for Neural Machine Translation

2019-09-03 · IJCNLP 2019 11 · Tianchi Bi, Hao Xiong, Zhongjun He, Hua Wu 외

Conventional Neural Machine Translation (NMT) models benefit from the training with an additional agent, e.g., dual learning, and bidirectional decoding with one agent decoding from left to right and the other decoding i…

Machine TranslationNMTTranslation

Phrase-based Machine Translation using Multiple Preordering Candidates

2016-12-01 · COLING 2016 12 · Yusuke Oda, Taku Kudo, Tetsuji Nakagawa, Taro Watanabe

In this paper, we propose a new decoding method for phrase-based statistical machine translation which directly uses multiple preordering candidates as a graph structure. Compared with previous phrase-based decoding meth…

DecoderMachine TranslationTranslation

STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation

2022-03-20 · ACL 2022 5 · Qingkai Fang, Rong Ye, Lei LI, Yang Feng 외

How to learn a better speech representation for end-to-end speech-to-text translation (ST) with limited labeled data? Existing techniques often attempt to transfer powerful machine translation (MT) capabilities to ST, bu…

Machine TranslationSpeech-to-TextSpeech-to-Text Translation

Twist Decoding: Diverse Generators Guide Each Other

2022-05-19 · Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Hao Peng 외

Many language generation models are now available for a wide range of generation tasks, including machine translation and summarization. Combining such diverse models may lead to further progress, but ensembling generati…

Machine TranslationRerankingText GenerationTranslation