paper-with-me

홈 › Papers

Contextual Neural Machine Translation Improves Translation of Cataphoric Pronouns

2020-04-21 · ACL 2020 6 · KayYen Wong, Sameen Maruf, Gholamreza Haffari

The advent of context-aware NMT has resulted in promising improvements in the overall translation quality and specifically in the translation of discourse phenomena such as pronouns. Previous works have mainly focused on the use of past sentences as context with a focus on anaphora translation. In this work, we investigate the effect of future sentences as context by comparing the performance of a contextual NMT model trained with the future context to the one trained with the past context. Our experiments and evaluation, using generic and pronoun-focused automatic metrics, show that the use of future context not only achieves significant improvements over the context-agnostic Transformer, but also demonstrates comparable and in some cases improved performance over its counterpart trained on past context. We also perform an evaluation on a targeted cataphora test suite and report significant gains over the context-agnostic Transformer in terms of BLEU.

📄 PDF Abstract BibTeX arXiv:2004.09894

Code (1)

sameenmaruf/acl2020-contextnmt-cataphora 공식 구현

Tasks

Machine TranslationNMTTranslation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Contextual Cues in Machine Translation: Investigating the Potential of Multi-Source Input Strategies in LLMs and NMT Systems

2025-03-10 · Lia Shahnazaryan, Patrick Simianer, Joern Wuebker

We explore the impact of multi-source input strategies on machine translation (MT) quality, comparing GPT-4o, a large language model (LLM), with a traditional multilingual neural machine translation (NMT) system. Using i…

Language ModelingLanguage ModellingLarge Language ModelMachine Translation+2

Contrastive Learning for Context-aware Neural Machine TranslationUsing Coreference Information

2021-09-13 · Yongkeun Hwang, Hyungu Yun, Kyomin Jung

Context-aware neural machine translation (NMT) incorporates contextual information of surrounding texts, that can improve the translation quality of document-level machine translation. Many existing works on context-awar…

Contrastive Learningcoreference-resolutionCoreference ResolutionData Augmentation+5

Contrastive Learning for Context-aware Neural Machine Translation Using Coreference Information

2021-11-01 · WMT (EMNLP) 2021 11 · Yongkeun Hwang, Hyeongu Yun, Kyomin Jung

Context-aware neural machine translation (NMT) incorporates contextual information of surrounding texts, that can improve the translation quality of document-level machine translation. Many existing works on context-awar…

Contrastive Learningcoreference-resolutionCoreference ResolutionData Augmentation+5

Context-Dependent Word Representation for Neural Machine Translation

2016-07-03 · Heeyoul Choi, Kyunghyun Cho, Yoshua Bengio

We first observe a potential weakness of continuous vector representations of symbols in neural machine translation. That is, the continuous vector representation, or a word embedding vector, of a symbol encodes multiple…

DecoderMachine TranslationSentenceTranslation

Multilingual Contextualization of Large Language Models for Document-Level Machine Translation

2025-04-16 · Miguel Moura Ramos, Patrick Fernandes, Sweta Agrawal, André F. T. Martins

Large language models (LLMs) have demonstrated strong performance in sentence-level machine translation, but scaling to document-level translation remains challenging, particularly in modeling long-range dependencies and…

Document Level Machine TranslationDocument TranslationMachine TranslationSentence+1