paper-with-me

Papers

Document-level Neural Machine Translation with Associated Memory Network

2019-10-31 · Shu Jiang, Rui Wang, Zuchao Li, Masao Utiyama, Kehai Chen, Eiichiro Sumita, Hai Zhao, Bao-liang Lu

Standard neural machine translation (NMT) is on the assumption that the document-level context is independent. Most existing document-level NMT approaches are satisfied with a smattering sense of global document-level information, while this work focuses on exploiting detailed document-level context in terms of a memory network. The capacity of the memory network that detecting the most relevant part of the current sentence from memory renders a natural solution to model the rich document-level context. In this work, the proposed document-aware memory network is implemented to enhance the Transformer NMT baseline. Experiments on several tasks show that the proposed method significantly improves the NMT performance over strong Transformer baselines and other related studies.

📄 PDF Abstract BibTeX arXiv:1910.14528

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationNMTSentenceTranslation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Learn To Remember: Transformer with Recurrent Memory for Document-Level Machine Translation

2022-05-03 · Findings (NAACL) 2022 7 · Yukun Feng, Feng Li, Ziang Song, Boyuan Zheng 외

The Transformer architecture has led to significant gains in machine translation. However, most studies focus on only sentence-level translation without considering the context dependency within documents, leading to the…

Document Level Machine TranslationMachine TranslationSentenceTranslation

SMDT: Selective Memory-Augmented Neural Document Translation

2022-01-05 · Xu Zhang, Jian Yang, Haoyang Huang, Shuming Ma 외

Existing document-level neural machine translation (NMT) models have sufficiently explored different context settings to provide guidance for target generation. However, little attention is paid to inaugurate more divers…

Document Level Machine TranslationDocument TranslationMachine TranslationNMT+2

Document Context Neural Machine Translation with Memory Networks

2017-11-10 · ACL 2018 7 · Sameen Maruf, Gholamreza Haffari

We present a document-level neural machine translation model which takes both source and target document context into account using memory networks. We model the problem as a structured prediction problem with interdepen…

Machine TranslationStructured PredictionTranslation

DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory

2024-10-10 · Yutong Wang, Jiali Zeng, Xuebo Liu, Derek F. Wong 외

Large language models (LLMs) have achieved reasonable quality improvements in machine translation (MT). However, most current research on MT-LLMs still faces significant challenges in maintaining translation consistency …

Document TranslationMachine TranslationProper NounSentence+1

Improving Long Context Document-Level Machine Translation

2023-06-08 · Christian Herold, Hermann Ney

Document-level context for neural machine translation (NMT) is crucial to improve the translation consistency and cohesion, the translation of ambiguous inputs, as well as several other linguistic phenomena. Many works h…

Document Level Machine TranslationMachine TranslationNMTSentence+1