paper-with-me

Papers

Structural Supervision for Word Alignment and Machine Translation

2022-05-01 · Findings (ACL) 2022 5 · Lei LI, Kai Fan, Hongjia Li, Chun Yuan

Syntactic structure has long been argued to be potentially useful for enforcing accurate word alignment and improving generalization performance of machine translation. Unfortunately, existing wisdom demonstrates its significance by considering only the syntactic structure of source tokens, neglecting the rich structural information from target tokens and the structural similarity between the source and target sentences. In this work, we propose to incorporate the syntactic structure of both source and target tokens into the encoder-decoder framework, tightly correlating the internal logic of word alignment and machine translation for multi-task learning. Particularly, we won’t leverage any annotated syntactic graph of the target side during training, so we introduce Dynamic Graph Convolution Networks (DGCN) on observed target tokens to sequentially and simultaneously generate the target tokens and the corresponding syntactic graphs, and further guide the word alignment. On this basis, Hierarchical Graph Random Walks (HGRW) are performed on the syntactic graphs of both source and target sides, for incorporating structured constraints on machine translation outputs. Experiments on four publicly available language pairs verify that our method is highly effective in capturing syntactic structure in different languages, consistently outperforming baselines in alignment accuracy and demonstrating promising results in translation quality.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderMachine TranslationMulti-Task LearningTranslationWord Alignment

Similar Papers 제목 키워드 기반

An Empirical Investigation of Word Alignment Supervision for Zero-Shot Multilingual Neural Machine Translation

2021-11-01 · EMNLP 2021 11 · Alessandro Raganato, Raúl Vázquez, Mathias Creutz, Jörg Tiedemann

Zero-shot translations is a fascinating feature of Multilingual Neural Machine Translation (MNMT) systems. These MNMT models are usually trained on English-centric data, i.e. English either as the source or target langua…

Machine TranslationTranslationWord Alignment

Inferring Shallow-Transfer Machine Translation Rules from Small Parallel Corpora

2014-01-15 · Felipe Sánchez-Martínez, Mikel L. Forcada

This paper describes a method for the automatic inference of structural transfer rules to be used in a shallow-transfer machine translation (MT) system from small parallel corpora. The structural transfer rules are based…

Machine TranslationSentenceTranslationWord Translation

Incorporating Structural Alignment Biases into an Attentional Neural Translation Model

2016-01-06 · NAACL 2016 6 · Trevor Cohn, Cong Duy Vu Hoang, Ekaterina Vymolova, Kaisheng Yao 외

Neural encoder-decoder models of machine translation have achieved impressive results, rivalling traditional translation models. However their modelling formulation is overly simplistic, and omits several key inductive b…

DecoderMachine TranslationTranslation

On the Relationship between Neural Machine Translation and Word Alignment

· Xintong Li, Lemao Liu, Guanlin Li, Max Meng 외

Prior researches suggest that attentional neural machine translation (NMT) is able to capture word alignment by attention, however, to our surprise, it almost fails for NMT models with multiple attentional layers except …

Machine TranslationNMTTranslationWord Alignment

Agreement-based Joint Training for Bidirectional Attention-based Neural Machine Translation

2015-12-15 · Yong Cheng, Shiqi Shen, Zhongjun He, wei he 외

The attentional mechanism has proven to be effective in improving end-to-end neural machine translation. However, due to the intricate structural divergence between natural languages, unidirectional attention-based model…

Machine TranslationTranslationWord Alignment