paper-with-me

홈 › Papers

Low-Resource Machine Translation based on Asynchronous Dynamic Programming

2021-08-01 · CCL 2021 8 · Jia Xiaoning, Hou Hongxu, Wu Nier, Li Haoran, Chang Xin

“Reinforcement learning has been proved to be effective in handling low resource machine trans-lation tasks and different sampling methods of reinforcement learning affect the performance ofthe model. The reward for generating translation is determined by the scalability and iteration ofthe sampling strategy so it is difficult for the model to achieve bias-variance trade-off. Therefore according to the poor ability of the model to analyze the structure of the sequence in low-resourcetasks this paper proposes a neural machine translation model parameter optimization method for asynchronous dynamic programming training strategies. In view of the experience priority situa-tion under the current strategy each selective sampling experience not only improves the value ofthe experience state but also avoids the high computational resource consumption inherent in tra-ditional valuation methods (such as dynamic programming). We verify the Mongolian-Chineseand Uyghur-Chinese tasks on CCMT2019. The result shows that our method has improved the quality of low-resource neural machine translation model compared with general reinforcement learning methods which fully demonstrates the effectiveness of our method.”

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

General Reinforcement LearningLow Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine Translationreinforcement-learningReinforcement LearningReinforcement Learning (RL)Translation

Similar Papers 제목 키워드 기반

CodeTransOcean: A Comprehensive Multilingual Benchmark for Code Translation

2023-10-08 · Weixiang Yan, Yuchen Tian, Yunzhe Li, Qian Chen 외

Recent code translation techniques exploit neural machine translation models to translate source code from one programming language to another to satisfy production compatibility or to improve efficiency of codebase main…

Code TranslationMachine TranslationTranslation

Joint User Scheduling and Computing Resource Allocation Optimization in Asynchronous Mobile Edge Computing Networks

2024-01-21 · Yihan Cang, Ming Chen, Yijin Pan, Zhaohui Yang 외

In this paper, the problem of joint user scheduling and computing resource allocation in asynchronous mobile edge computing (MEC) networks is studied. In such networks, edge devices will offload their computational tasks…

Edge-computingScheduling

Accelerating Asynchronous Stochastic Gradient Descent for Neural Machine Translation

2018-08-27 · EMNLP 2018 10 · Nikolay Bogoychev, Marcin Junczys-Dowmunt, Kenneth Heafield, Alham Fikri Aji

In order to extract the best possible performance from asynchronous stochastic gradient descent one must increase the mini-batch size and scale the learning rate accordingly. In order to achieve further speedup we introd…

Machine TranslationTranslation

Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation

2020-05-03 · ACL 2020 6 · Xuanli He, Gholamreza Haffari, Mohammad Norouzi

This paper introduces Dynamic Programming Encoding (DPE), a new segmentation algorithm for tokenizing sentences into subword units. We view the subword segmentation of output sentences as a latent variable that should be…

Machine TranslationSegmentationTranslation

Speeding Up Neural Machine Translation Decoding by Cube Pruning

2018-09-09 · EMNLP 2018 10 · Wen Zhang, Liang Huang, Yang Feng, Lei Shen 외

Although neural machine translation has achieved promising results, it suffers from slow translation speed. The direct consequence is that a trade-off has to be made between translation quality and speed, thus its perfor…

Machine TranslationTranslation