paper-with-me

Papers

Combining Local and Document-Level Context: The LMU Munich Neural Machine Translation System at WMT19

2019-08-01 · WS 2019 8 · Dario Stojanovski, Alex Fraser, er

We describe LMU Munich{'}s machine translation system for English→German translation which was used to participate in the WMT19 shared task on supervised news translation. We specifically participated in the document-level MT track. The system used as a primary submission is a context-aware Transformer capable of both rich modeling of limited contextual information and integration of large-scale document-level context with a less rich representation. We train this model by fine-tuning a big Transformer baseline. Our experimental results show that document-level context provides for large improvements in translation quality, and adding a rich representation of the previous sentence provides a small additional gain.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationSentenceTranslation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

MUNIChus: Multilingual News Image Captioning Benchmark

2026-03-11 · Yuji Chen, Alistair Plum, Hansi Hettiarachchi, Diptesh Kanojia 외 arxiv

The goal of news image captioning is to generate captions by integrating news article content with corresponding images, highlighting the relationship between textual context and visual elements. The majority of research…

Image Captioning

Extractive Summarization of Long Documents by Combining Global and Local Context

2019-09-17 · IJCNLP 2019 11 · Wen Xiao, Giuseppe Carenini

In this paper, we propose a novel neural single document extractive summarization model for long documents, incorporating both the global context of the whole document and the local context within the current topic. We e…

Extractive SummarizationText Summarization

Global Attention for Name Tagging

2020-10-19 · CONLL 2018 10 · Boliang Zhang, Spencer Whitehead, Lifu Huang, Heng Ji

Many name tagging approaches use local contextual information with much success, but fail when the local context is ambiguous or limited. We present a new framework to improve name tagging by utilizing local, document-le…

Generating Uncontextualized and Contextualized Questions for Document-Level Event Argument Extraction

2024-04-07 · Md Nayem Uddin, Enfa Rose George, Eduardo Blanco, Steven Corman

This paper presents multiple question generation strategies for document-level event argument extraction. These strategies do not require human involvement and result in uncontextualized questions as well as contextualiz…

Event Argument ExtractionQuestion GenerationQuestion-Generation

Document-Level Relation Extraction with Adaptive Thresholding and Localized Context Pooling

2020-10-21 · Wenxuan Zhou, Kevin Huang, Tengyu Ma, Jing Huang

Document-level relation extraction (RE) poses new challenges compared to its sentence-level counterpart. One document commonly contains multiple entity pairs, and one entity pair occurs multiple times in the document ass…

Document-level Relation ExtractionMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONRelation+2