Search Engine Guided Non-Parametric Neural Machine Translation
In this paper, we extend an attention-based neural machine translation (NMT) model by allowing it to access an entire training set of parallel sentence pairs even after training. The proposed approach consists of two stages. In the first stage--retrieval stage--, an off-the-shelf, black-box search engine is used to retrieve a small subset of sentence pairs from a training set given a source sentence. These pairs are further filtered based on a fuzzy matching score based on edit distance. In the second stage--translation stage--, a novel translation model, called translation memory enhanced NMT (TM-NMT), seamlessly uses both the source sentence and a set of retrieved sentence pairs to perform the translation. Empirical evaluation on three language pairs (En-Fr, En-De, and En-Es) shows that the proposed approach significantly outperforms the baseline approach and the improvement is more significant when more relevant sentence pairs were retrieved.
Code (0)
등록된 구현이 없습니다.
Tasks
fr-enMachine TranslationNMTRetrievalSentenceTranslationSimilar Papers 제목 키워드 기반
Improve MT for Search with Selected Translation Memory using Search Signals
Multilingual search is indispensable for a seamless e-commerce experience. E-commerce search engines typically support multilingual search by cascading a machine translation step before searching the index in its primary…
Machine TranslationTranslationA Use Case: Reformulating Query Rewriting as a Statistical Machine Translation Problem
One of the most important challenges for modern search engines is to retrieve relevant web content based on user queries. In order to achieve this challenge, search engines have a module to rewrite user queries. That is …
Machine TranslationTranslationKeyframe Segmentation and Positional Encoding for Video-guided Machine Translation Challenge 2020
Video-guided machine translation as one of multimodal neural machine translation tasks targeting on generating high-quality text translation by tangibly engaging both video and text. In this work, we presented our video-…
Machine TranslationTranslationVideo-Guided Machine TranslationMTee: Open Machine Translation Platform for Estonian Government
We present the MTee project - a research initiative funded via an Estonian public procurement to develop machine translation technology that is open-source and free of charge. The MTee project delivered an open-source pl…
Document TranslationGrammatical Error CorrectionMachine TranslationTranslationNon-parametric, Nearest-neighbor-assisted Fine-tuning for Neural Machine Translation
Non-parametric, k-nearest-neighbor algorithms have recently made inroads to assist generative models such as language models and machine translation decoders. We explore whether such non-parametric models can improve mac…
Machine TranslationTranslation