paper-with-me

홈 › Papers

Sockeye: A Toolkit for Neural Machine Translation

2017-12-15 · Felix Hieber, Tobias Domhan, Michael Denkowski, David Vilar, Artem Sokolov, Ann Clifton, Matt Post

We describe Sockeye (version 1.12), an open-source sequence-to-sequence toolkit for Neural Machine Translation (NMT). Sockeye is a production-ready framework for training and applying models as well as an experimental platform for researchers. Written in Python and built on MXNet, the toolkit offers scalable training and inference for the three most prominent encoder-decoder architectures: attentional recurrent neural networks, self-attentional transformers, and fully convolutional networks. Sockeye also supports a wide range of optimizers, normalization and regularization techniques, and inference improvements from current NMT literature. Users can easily run standard training recipes, explore different model settings, and incorporate new ideas. In this paper, we highlight Sockeye's features and benchmark it against other NMT toolkits on two language arcs from the 2017 Conference on Machine Translation (WMT): English-German and Latvian-English. We report competitive BLEU scores across all three architectures, including an overall best score for Sockeye's transformer implementation. To facilitate further comparison, we release all system outputs and training scripts used in our experiments. The Sockeye toolkit is free software released under the Apache 2.0 license.

📄 PDF Abstract BibTeX arXiv:1712.05690

Code (16)

awslabs/sockeye 공식 구현 mxnet
Izecson/saml-nmt mxnet
Izecson/sockeye-1.16.6 tf
StatNLP/joeynmt pytorch
ZurichNLP/sockeye mxnet
benjaminbeilharz/hierarchical-reinforcement-learning pytorch
ducthanhtran/sockeye_document_context mxnet
jarl93/joeynmt-modified pytorch
joeynmt/joeynmt pytorch
juliakreutzer/joeynmt pytorch
nrc-cnrc/sockeye-multisource mxnet
penny9287/sockeye mxnet
songchujun/joeynmt pytorch
xingniu/sockeye mxnet
yunsukim86/sockeye-noise mxnet
yunsukim86/sockeye-transfer mxnet

Tasks

DecoderMachine TranslationNMTTranslation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Sockeye 2: A Toolkit for Neural Machine Translation

2020-11-01 · EAMT 2020 11 · Felix Hieber, Tobias Domhan, Michael Denkowski, David Vilar

We present Sockeye 2, a modernized and streamlined version of the Sockeye neural machine translation (NMT) toolkit. New features include a simplified code base through the use of MXNet’s Gluon API, a focus on state of th…

Machine TranslationNMTTranslation

The Sockeye 2 Neural Machine Translation Toolkit at AMTA 2020

2020-08-11 · AMTA 2020 10 · Tobias Domhan, Michael Denkowski, David Vilar, Xing Niu 외

We present Sockeye 2, a modernized and streamlined version of the Sockeye neural machine translation (NMT) toolkit. New features include a simplified code base through the use of MXNet's Gluon API, a focus on state of th…

CPUMachine TranslationNMTQuantization+1

Sockeye 3: Fast Neural Machine Translation with PyTorch

2022-07-12 · Felix Hieber, Michael Denkowski, Tobias Domhan, Barbara Darques Barros 외

Sockeye 3 is the latest version of the Sockeye toolkit for Neural Machine Translation (NMT). Now based on PyTorch, Sockeye 3 provides faster model implementations and more advanced features with a further streamlined cod…

Machine TranslationNMTTranslation

The Sockeye Neural Machine Translation Toolkit at AMTA 2018

2018-03-01 · WS 2018 3 · Felix Hieber, Tobias Domhan, Michael Denkowski, David Vilar 외
Machine TranslationTranslation

Russian-English Bidirectional Machine Translation System

2020-11-01 · WMT (EMNLP) 2020 11 · Ariel Xv

This review depicts our submission to the WMT20 shared news translation task. WMT is the conference to assess the level of machine translation capabilities of organizations in the word. We participated in one language pa…

Machine TranslationTranslation