Neural Machine Translation with Source Dependency Representation
Source dependency information has been successfully introduced into statistical machine translation. However, there are only a few preliminary attempts for Neural Machine Translation (NMT), such as concatenating representations of source word and its dependency label together. In this paper, we propose a novel NMT with source dependency representation to improve translation performance of NMT, especially long sentences. Empirical results on NIST Chinese-to-English translation task show that our method achieves 1.6 BLEU improvements on average over a strong NMT system.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationNMTTranslationSimilar Papers 제목 키워드 기반
Dependency-Based Relative Positional Encoding for Transformer NMT
This paper proposes a new Transformer neural machine translation model that incorporates syntactic distances between two source words into the relative position representations of the self-attention mechanism. In particu…
Machine TranslationNMTPositionTranslationDePA: Improving Non-autoregressive Machine Translation with Dependency-Aware Decoder
Non-autoregressive machine translation (NAT) models have lower translation quality than autoregressive translation (AT) models because NAT decoders do not depend on previous target tokens in the decoder input. We propose…
DecoderMachine TranslationTranslationA Dependency-Based Neural Reordering Model for Statistical Machine Translation
In machine translation (MT) that involves translating between two languages with significant differences in word order, determining the correct word order of translated words is a major challenge. The dependency parse tr…
Machine TranslationSentenceTranslationData Augmentation for Machine Translation via Dependency Subtree Swapping
We present a generic framework for data augmentation via dependency subtree swapping that is applicable to machine translation. We extract corresponding subtrees from the dependency parse trees of the source and target s…
Data AugmentationMachine TranslationTranslationSyntactic Knowledge via Graph Attention with BERT in Machine Translation
Although the Transformer model can effectively acquire context features via a self-attention mechanism, deeper syntactic knowledge is still not effectively modeled. To alleviate the above problem, we propose Syntactic kn…
Graph AttentionMachine TranslationText GenerationTranslation