paper-with-me

홈 › Papers

Our Neural Machine Translation Systems for WAT 2019

2019-11-01 · WS 2019 11 · Wei Yang, Jun Ogata

In this paper, we describe our Neural Machine Translation (NMT) systems for the WAT 2019 translation tasks we focus on. This year we participate in scientific paper tasks and focus on the language pair between English and Japanese. We use Transformer model through our work in this paper to explore and experience the powerful of the Transformer architecture relying on self-attention mechanism. We use different NMT toolkit/library as the implementation of training the Transformer model. For word segmentation, we use different subword segmentation strategies while using different toolkit/library. We not only give the translation accuracy obtained based on absolute position encodings that introduced in the Transformer model, but also report the the improvements in translation accuracy while replacing absolute position encodings with relative position representations. We also ensemble several independent trained Transformer models to further improve the translation accuracy.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationNMTPositionSegmentationTranslation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Opportunities for Human-centered Evaluation of Machine Translation Systems

2022-07-01 · Findings (NAACL) 2022 7 · Daniel Liebling, Katherine Heller, Samantha Robertson, Wesley Deng

Machine translation models are embedded in larger user-facing systems. Although model evaluation has matured, evaluation at the systems level is still lacking. We review literature from both the translation studies and H…

Machine TranslationTranslation

JUNLP@ICON2020: Low Resourced Machine Translation for Indic Languages

2020-12-01 · ICON 2020 12 · Sainik Mahata, Dipankar Das, Sivaji Bandyopadhyay

In the current work, we present the description of the systems submitted to a machine translation shared task organized by ICON 2020: 17th International Conference on Natural Language Processing. The systems were develop…

Machine TranslationTranslation

Adaptation and Combination of NMT Systems: The KIT Translation Systems for IWSLT 2016

2016-12-01 · IWSLT 2016 12 · Eunah Cho, Jan Niehues, Thanh-Le Ha, Matthias Sperber 외

In this paper, we present the KIT systems of the IWSLT 2016 machine translation evaluation. We participated in the machine translation (MT) task as well as the spoken language language translation (SLT) track for English…

Domain AdaptationMachine TranslationNMTTranslation

Neural-based machine translation for medical text domain. Based on European Medicines Agency leaflet texts

2015-09-29 · Krzysztof Wołk, Krzysztof Marasek

The quality of machine translation is rapidly evolving. Today one can find several machine translation systems on the web that provide reasonable translations, although the systems are not perfect. In some specific domai…

DecoderMachine TranslationSentenceTranslation

Byte-based Neural Machine Translation

2017-09-01 · WS 2017 9 · Marta R. Costa-juss{\`a}, Carlos Escolano, Jos{\'e} A. R. Fonollosa

This paper presents experiments comparing character-based and byte-based neural machine translation systems. The main motivation of the byte-based neural machine translation system is to build multi-lingual neural machin…

Language ModelingLanguage ModellingMachine TranslationNamed Entity Recognition (NER)+2