Meteor++: Incorporating Copy Knowledge into Machine Translation Evaluation
In machine translation evaluation, a good candidate translation can be regarded as a paraphrase of the reference. We notice that some words are always copied during paraphrasing, which we call \textbf{copy knowledge}. Considering the stability of such knowledge, a good candidate translation should contain all these words appeared in the reference sentence. Therefore, in this participation of the WMT{'}2018 metrics shared task we introduce a simple statistical method for copy knowledge extraction, and incorporate it into Meteor metric, resulting in a new machine translation metric \textbf{Meteor++}. Our experiments show that Meteor++ can nicely integrate copy knowledge and improve the performance significantly on WMT17 and WMT15 evaluation sets.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationSentenceText GenerationTranslationSimilar Papers 제목 키워드 기반
Meteor++ 2.0: Adopt Syntactic Level Paraphrase Knowledge into Machine Translation Evaluation
This paper describes Meteor++ 2.0, our submission to the WMT19 Metric Shared Task. The well known Meteor metric improves machine translation evaluation by introducing paraphrase knowledge. However, it only focuses on the…
Machine TranslationTranslationKnowledge Based Template Machine Translation In Low-Resource Setting
Incorporating tagging into neural machine translation (NMT) systems has shown promising results in helping translate rare words such as named entities (NE). However, translating NE in low-resource setting remains a chall…
Knowledge GraphsMachine TranslationNMTPOS+3Knowledge Based Template Machine Translation In Low-Resource Setting
Incorporating tagging into neural machine translation (NMT) systems has shown promising results in helping translate rare words such as named entities (NE). However, translating NE in low-resource setting remains a chall…
Knowledge GraphsMachine TranslationNMTPOS+3Converting the Point of View of Messages Spoken to Virtual Assistants
Virtual Assistants can be quite literal at times. If the user says "tell Bob I love him," most virtual assistants will extract the message "I love him" and send it to the user's contact named Bob, rather than properly co…
Constituency ParsingLanguage ModellingMachine TranslationNMT+4Augmenting Neural Machine Translation with Knowledge Graphs
While neural networks have been used extensively to make substantial progress in the machine translation task, they are known for being heavily dependent on the availability of large amounts of training data. Recent effo…
Knowledge GraphsMachine TranslationNMTTranslation