paper-with-me

홈 › Papers

Improving Word Sense Disambiguation in Neural Machine Translation with Salient Document Context

2023-11-27 · Elijah Rippeth, Marine Carpuat, Kevin Duh, Matt Post

Lexical ambiguity is a challenging and pervasive problem in machine translation (\mt). We introduce a simple and scalable approach to resolve translation ambiguity by incorporating a small amount of extra-sentential context in neural \mt. Our approach requires no sense annotation and no change to standard model architectures. Since actual document context is not available for the vast majority of \mt training data, we collect related sentences for each input to construct pseudo-documents. Salient words from pseudo-documents are then encoded as a prefix to each source sentence to condition the generation of the translation. To evaluate, we release \docmucow, a challenge set for translation disambiguation based on the English-German \mucow \cite{raganato-etal-2020-evaluation} augmented with document IDs. Extensive experiments show that our method translates ambiguous source words better than strong sentence-level baselines and comparable document-level baselines while reducing training costs.

📄 PDF Abstract BibTeX arXiv:2311.15507

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationSentenceTranslationWord Sense Disambiguation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Verb sense disambiguation in Machine Translation

2016-12-01 · WS 2016 12 · Roman Sudarikov, Ond{\v{r}}ej Du{\v{s}}ek, Martin Holub, Ond{\v{r}}ej Bojar 외

We describe experiments in Machine Translation using word sense disambiguation (WSD) information. This work focuses on WSD in verbs, based on two different approaches {--} verbal patterns based on corpus pattern analysis…

Machine TranslationTranslationWord Sense Disambiguation

Improving Word Sense Disambiguation in Neural Machine Translation with Sense Embeddings

2017-09-01 · WS 2017 9 · Annette Rios Gonzales, Laura Mascarell, Rico Sennrich
Machine TranslationTranslationWord Sense Disambiguation

An Evaluation Benchmark for Testing the Word Sense Disambiguation Capabilities of Machine Translation Systems

2020-05-01 · LREC 2020 5 · Aless Raganato, ro, Yves Scherrer, J{\"o}rg Tiedemann

Lexical ambiguity is one of the many challenging linguistic phenomena involved in translation, i.e., translating an ambiguous word with its correct sense. In this respect, previous work has shown that the translation qua…

Machine TranslationTranslationWord Sense Disambiguation

Word Sense-Aware Machine Translation: Including Senses as Contextual Features for Improved Translation Models

2016-05-01 · LREC 2016 5 · Steven Neale, Lu{\'\i}s Gomes, Eneko Agirre, Oier Lopez de Lacalle 외

Although it is commonly assumed that word sense disambiguation (WSD) should help to improve lexical choice and improve the quality of machine translation systems, how to successfully integrate word senses into such syste…

Machine TranslationTranslationWord Sense Disambiguation

Integrating Weakly Supervised Word Sense Disambiguation into Neural Machine Translation

2018-10-05 · TACL 2018 1 · Xiao Pu, Nikolaos Pappas, James Henderson, Andrei Popescu-Belis

This paper demonstrates that word sense disambiguation (WSD) can improve neural machine translation (NMT) by widening the source context considered when modeling the senses of potentially ambiguous words. We first introd…

ClusteringMachine TranslationNMTTranslation+1