paper-with-me

홈 › Papers

Point, Disambiguate and Copy: Incorporating Bilingual Dictionaries for Neural Machine Translation

2021-08-01 · ACL 2021 5 · Tong Zhang, Long Zhang, Wei Ye, Bo Li, Jinan Sun, Xiaoyu Zhu, Wen Zhao, Shikun Zhang

This paper proposes a sophisticated neural architecture to incorporate bilingual dictionaries into Neural Machine Translation (NMT) models. By introducing three novel components: Pointer, Disambiguator, and Copier, our method PDC achieves the following merits inherently compared with previous efforts: (1) Pointer leverages the semantic information from bilingual dictionaries, for the first time, to better locate source words whose translation in dictionaries can potentially be used; (2) Disambiguator synthesizes contextual information from the source view and the target view, both of which contribute to distinguishing the proper translation of a specific source word from multiple candidates in dictionaries; (3) Copier systematically connects Pointer and Disambiguator based on a hierarchical copy mechanism seamlessly integrated with Transformer, thereby building an end-to-end architecture that could avoid error propagation problems in alternative pipe-line methods. The experimental results on Chinese-English and English-Japanese benchmarks demonstrate the PDC{'}s overall superiority and effectiveness of each component.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationNMTTranslation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Incorporating Bilingual Dictionaries for Low Resource Semi-Supervised Neural Machine Translation

2020-04-05 · ICLR Workshop LLD 2019 · Sreyashi Nag, Mihir Kale, Varun Lakshminarasimhan, Swapnil Singhavi

We explore ways of incorporating bilingual dictionaries to enable semi-supervised neural machine translation. Conventional back-translation methods have shown success in leveraging target side monolingual data. However, …

Data AugmentationMachine TranslationTranslation

Creating Reverse Bilingual Dictionaries

2022-08-08 · NAACL 2013 6 · Khang Nhut Lam, Jugal Kalita

Bilingual dictionaries are expensive resources and not many are available when one of the languages is resource-poor. In this paper, we propose algorithms for creation of new reverse bilingual dictionaries from existing …

Reverse Dictionary

Bilingual dictionaries for all EU languages

2014-05-01 · LREC 2014 5 · Ahmet Aker, Monica Paramita, M{\=a}rcis Pinnis, Robert Gaizauskas

Bilingual dictionaries can be automatically generated using the GIZA++ tool. However, these dictionaries contain a lot of noise, because of which the quality of outputs of tools relying on the dictionaries are negatively…

AllMachine TranslationTranslationTransliteration

OpenLogos Semantico-Syntactic Knowledge-Rich Bilingual Dictionaries

2014-05-01 · LREC 2014 5 · Anabela Barreiro, Fern Batista, o, Ricardo Ribeiro 외

This paper presents 3 sets of OpenLogos resources, namely the English-German, the English-French, and the English-Italian bilingual dictionaries. In addition to the usual information on part-of-speech, gender, and number…

Machine TranslationTranslation

Automatically Creating a Large Number of New Bilingual Dictionaries

2022-08-12 · Khang Nhut Lam, Feras Al Tarouti, Jugal Kalita

This paper proposes approaches to automatically create a large number of new bilingual dictionaries for low-resource languages, especially resource-poor and endangered languages, from a single input bilingual dictionary.…