paper-with-me

Papers

Non-Parametric Online Learning from Human Feedback for Neural Machine Translation

2021-09-23 · Dongqi Wang, Haoran Wei, Zhirui Zhang, ShuJian Huang, Jun Xie, Jiajun Chen

We study the problem of online learning with human feedback in the human-in-the-loop machine translation, in which the human translators revise the machine-generated translations and then the corrected translations are used to improve the neural machine translation (NMT) system. However, previous methods require online model updating or additional translation memory networks to achieve high-quality performance, making them inflexible and inefficient in practice. In this paper, we propose a novel non-parametric online learning method without changing the model structure. This approach introduces two k-nearest-neighbor (knn) modules: one module memorizes the human feedback, which is the correct sentences provided by human translators, while the other balances the usage of the history human feedback and original NMT models adaptively. Experiments conducted on EMEA and JRC-Acquis benchmarks demonstrate that our proposed method obtains substantial improvements on translation accuracy and achieves better adaptation performance with less repeating human correction operations.

📄 PDF Abstract BibTeX arXiv:2109.11136

Code (1)

wangqi1996/kok 공식 구현 pytorch

Tasks

Machine TranslationNMTTranslation

Methods 이 논문이 사용한 방법론

EMEA Entropy Minimized Ensemble of Adapters, or EMEA, is a method that optimizes the ensemble weights of the pretrained language adapters for each test sentence by minimizing…

Similar Papers 제목 키워드 기반

Online Learning Meets Machine Translation Evaluation: Finding the Best Systems with the Least Human Effort

2021-05-27 · ACL 2021 5 · Vânia Mendonça, Ricardo Rei, Luisa Coheur, Alberto Sardinha 외

In Machine Translation, assessing the quality of a large amount of automatic translations can be challenging. Automatic metrics are not reliable when it comes to high performing systems. In addition, resorting to human e…

Machine TranslationTranslation

A Reinforcement Learning Approach to Interactive-Predictive Neural Machine Translation

2018-05-03 · Tsz Kin Lam, Julia Kreutzer, Stefan Riezler

We present an approach to interactive-predictive neural machine translation that attempts to reduce human effort from three directions: Firstly, instead of requiring humans to select, correct, or delete segments, we empl…

Machine Translationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

ChrEnTranslate: Cherokee-English Machine Translation Demo with Quality Estimation and Corrective Feedback

2021-07-30 · ACL 2021 5 · Shiyue Zhang, Benjamin Frey, Mohit Bansal

We introduce ChrEnTranslate, an online machine translation demonstration system for translation between English and an endangered language Cherokee. It supports both statistical and neural translation models as well as p…

Machine TranslationNMTSentenceTranslation+1

Reinforcement Learning for Bandit Neural Machine Translation with Simulated Human Feedback

2017-07-24 · EMNLP 2017 9 · Khanh Nguyen, Hal Daumé III, Jordan Boyd-Graber

Machine translation is a natural candidate problem for reinforcement learning from human feedback: users provide quick, dirty ratings on candidate translations to guide a system to improve. Yet, current neural machine tr…

DecoderMachine Translationreinforcement-learningReinforcement Learning+2

Learning Kernel-Smoothed Machine Translation with Retrieved Examples

2021-09-21 · EMNLP 2021 11 · Qingnan Jiang, Mingxuan Wang, Jun Cao, Shanbo Cheng 외

How to effectively adapt neural machine translation (NMT) models according to emerging cases without retraining? Despite the great success of neural machine translation, updating the deployed models online remains a chal…

Domain AdaptationMachine TranslationNMTRetrieval+1