OpenNMT System Description for WNMT 2018: 800 words/sec on a single-core CPU
We present a system description of the OpenNMT Neural Machine Translation entry for the WNMT 2018 evaluation. In this work, we developed a heavily optimized NMT inference model targeting a high-performance CPU system. The final system uses a combination of four techniques, all of them lead to significant speed-ups in combination: (a) sequence distillation, (b) architecture modifications, (c) precomputation, particularly of vocabulary, and (d) CPU targeted quantization. This work achieves the fastest performance of the shared task, and led to the development of new features that have been integrated to OpenNMT and available to the community.
Code (0)
등록된 구현이 없습니다.
Tasks
CPUMachine TranslationNeural Architecture SearchNMTQuantizationTranslationSimilar Papers 제목 키워드 기반
The SPECTRANS System Description for the WMT21 Terminology Task
This paper discusses the WMT 2021 terminology shared task from a “meta” perspective. We present the results of our experiments using the terminology dataset and the OpenNMT (Klein et al., 2017) and JoeyNMT (Kreutzer et a…
OpenNMT: Neural Machine Translation Toolkit
OpenNMT is an open-source toolkit for neural machine translation (NMT). The system prioritizes efficiency, modularity, and extensibility with the goal of supporting NMT research into model architectures, feature represen…
Machine TranslationNMTTranslationAmharic-Arabic Neural Machine Translation
Many automatic translation works have been addressed between major European language pairs, by taking advantage of large scale parallel corpora, but very few research works are conducted on the Amharic-Arabic language pa…
DecoderMachine TranslationNMTTranslationMarian: Cost-effective High-Quality Neural Machine Translation in C++
This paper describes the submissions of the "Marian" team to the WNMT 2018 shared task. We investigate combinations of teacher-student training, low-precision matrix products, auto-tuning and other methods to optimize th…
CPUGPUMachine TranslationTranslation+1