Tensor2Tensor for Neural Machine Translation
Tensor2Tensor is a library for deep learning models that is well-suited for neural machine translation and includes the reference implementation of the state-of-the-art Transformer model.
Code (15)
Tasks
Deep LearningMachine TranslationTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Densifying Assumed-sparse Tensors: Improving Memory Efficiency and MPI Collective Performance during Tensor Accumulation for Parallelized Training of Neural Machine Translation Models
Neural machine translation - using neural networks to translate human language - is an area of active research exploring new neuron types and network topologies with the goal of dramatically improving machine translation…
CPUMachine TranslationTranslationTensorCoder: Dimension-Wise Attention via Tensor Representation for Natural Language Modeling
Transformer has been widely-used in many Natural Language Processing (NLP) tasks and the scaled dot-product attention between tokens is a core module of Transformer. This attention is a token-wise design and its complexi…
Language ModelingLanguage ModellingMachine TranslationMasked Language Modeling+1Riemannian Stochastic Gradient Descent for Tensor-Train Recurrent Neural Networks
The Tensor-Train factorization (TTF) is an efficient way to compress large weight matrices of fully-connected layers and recurrent layers in recurrent neural networks (RNNs). However, high Tensor-Train ranks for all the …
DecoderMachine TranslationTranslationTraining Neural Machine Translation (NMT) Models using Tensor Train Decomposition on TensorFlow (T3F)
We implement a Tensor Train layer in the TensorFlow Neural Machine Translation (NMT) model using the t3f library. We perform training runs on the IWSLT English-Vietnamese '15 and WMT German-English '16 datasets with lear…
Machine TranslationNMTTranslationLeFlow: Enabling Flexible FPGA High-Level Synthesis of Tensorflow Deep Neural Networks
Recent work has shown that Field-Programmable Gate Arrays (FPGAs) play an important role in the acceleration of Machine Learning applications. Initial specification of machine learning applications are often done using a…
BIG-bench Machine LearningHigh-Level SynthesisTranslation