Multi-Reward based Reinforcement Learning for Neural Machine Translation

2020-10-01 · CCL 2020 10 · Shuo Sun, Hongxu Hou, Nier Wu, Ziyue Guo, Chaowei Zhang

Reinforcement learning (RL) has made remarkable progress in neural machine translation (NMT). However, it exists the problems with uneven sampling distribution, sparse rewards and high variance in training phase. Therefore, we propose a multi-reward reinforcement learning training strategy to decouple action selection and value estimation. Meanwhile, our method combines with language model rewards to jointly optimize model parameters. In addition, we add Gumbel noise in sampling to obtain more effective semantic information. To verify the robustness of our method, we not only conducted experiments on large corpora, but also performed on low-resource languages. Experimental results show that our work is superior to the baselines in WMT14 English-German, LDC2014 Chinese-English and CWMT2018 Mongolian-Chinese tasks, which fully certificates the effectiveness of our method.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modelling Machine TranslationNMTreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Translation

Comparing BERT-based Reward Functions for Deep Reinforcement Learning in Machine Translation

2022-10-01 · WAT 2022 10 · Yuki Nakatani, Tomoyuki Kajiwara, Takashi Ninomiya

In text generation tasks such as machine translation, models are generally trained using cross-entropy loss. However, mismatches between the loss function and the evaluation metric are often problematic. It is known that…

Deep Reinforcement Learning Machine Translation reinforcement-learning Reinforcement Learning+3

Neural Machine Translation with Adequacy-Oriented Learning

2018-11-21 · Xiang Kong, Zhaopeng Tu, Shuming Shi, Eduard Hovy 외

Although Neural Machine Translation (NMT) models have advanced state-of-the-art performance in machine translation, they face problems like the inadequate translation. We attribute this to that the standard Maximum Likel…

Attribute Machine Translation NMT Reinforcement Learning+2

Multimodal Machine Translation with Reinforcement Learning

2018-05-07 · Xin Qian, Ziyi Zhong, Jieli Zhou

Multimodal machine translation is one of the applications that integrates computer vision and language processing. It is a unique task given that in the field of machine translation, many state-of-the-arts algorithms sti…

Image Description Machine Translation Multimodal Machine Translation reinforcement-learning+3

ExTrans: Multilingual Deep Reasoning Translation via Exemplar-Enhanced Reinforcement Learning

2025-05-19 · Jiaan Wang, Fandong Meng, Jie zhou

In recent years, the emergence of large reasoning models (LRMs), such as OpenAI-o1 and DeepSeek-R1, has shown impressive capabilities in complex problems, e.g., mathematics and coding. Some pioneering studies attempt to …

Machine Translation reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

PAMT: Process-Aligned Reinforcement Learning for Multi-Domain Machine Translation

2026-08-04 · Yongshi Ye, Biao Fu, Chongxuan Huang, Yidong Chen 외 arxiv

Multi-domain machine translation (MDMT) requires more than fluent generation: it demands domain-sensitive translation decisions such as domain disambiguation, terminology control, and stylistic adaptation. Large reasonin…

Reinforcement Learning Machine Translation