Fast Neural Machine Translation Implementation

2018-05-24 · WS 2018 7 · Hieu Hoang, Tomasz Dwojak, Rihards Krislauks, Daniel Torregrosa, Kenneth Heafield

This paper describes the submissions to the efficiency track for GPUs at the Workshop for Neural Machine Translation and Generation by members of the University of Edinburgh, Adam Mickiewicz University, Tilde and University of Alicante. We focus on efficient implementation of the recurrent deep-learning model as implemented in Amun, the fast inference engine for neural machine translation. We improve the performance with an efficient mini-batching algorithm, and by fusing the softmax operation with the k-best extraction algorithm. Submissions using Amun were first, second and third fastest in the GPU efficiency track.

📄 PDF Abstract BibTeX arXiv:1805.09863

Code (0)

등록된 구현이 없습니다.

Tasks

GPUMachine Translation Translation

Methods 이 논문이 사용한 방법론

Adam 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Sockeye 3: Fast Neural Machine Translation with PyTorch

2022-07-12 · Felix Hieber, Michael Denkowski, Tobias Domhan, Barbara Darques Barros 외

Sockeye 3 is the latest version of the Sockeye toolkit for Neural Machine Translation (NMT). Now based on PyTorch, Sockeye 3 provides faster model implementations and more advanced features with a further streamlined cod…

Machine Translation NMT Translation

Fast, Scalable Phrase-Based SMT Decoding

2016-10-13 · AMTA 2016 10 · Hieu Hoang, Nikolay Bogoychev, Lane Schwartz, Marcin Junczys-Dowmunt

The utilization of statistical machine translation (SMT) has grown enormously over the last decade, many using open-source software developed by the NLP community. As commercial use has increased, there is need for softw…

Decoder Machine Translation Translation

Kyoto-NMT: a Neural Machine Translation implementation in Chainer

2016-12-01 · COLING 2016 12 · Fabien Cromi{\`e}res

We present Kyoto-NMT, an open-source implementation of the Neural Machine Translation paradigm. This implementation is done in Python and Chainer, an easy-to-use Deep Learning Framework.

Deep Learning Language Modeling Language Modelling Machine Translation+2

FastWave: Accelerating Autoregressive Convolutional Neural Networks on FPGA

2020-02-09 · Shehzeen Hussain, Mojan Javaheripi, Paarth Neekhara, Ryan Kastner 외

Autoregressive convolutional neural networks (CNNs) have been widely exploited for sequence generation tasks such as audio synthesis, language modeling and neural machine translation. WaveNet is a deep autoregressive CNN…

Audio Generation Audio Synthesis CPU GPU+4

Speeding up Transformer Decoding via an Attention Refinement Network

2022-10-01 · COLING 2022 10 · Kaixin Wu, Yue Zhang, Bojie Hu, Tong Zhang

Despite the revolutionary advances made by Transformer in Neural Machine Translation (NMT), inference efficiency remains an obstacle due to the heavy use of attention operations in auto-regressive decoding. We thereby pr…