Does Multimodality Help Human and Machine for Translation and Image Captioning?
This paper presents the systems developed by LIUM and CVC for the WMT16 Multimodal Machine Translation challenge. We explored various comparative methods, namely phrase-based systems and attentional recurrent neural networks models trained using monomodal or multimodal data. We also performed a human evaluation in order to estimate the usefulness of multimodal data for human machine translation and image description generation. Our systems obtained the best results for both tasks according to the automatic evaluation metrics BLEU and METEOR.
Code (1)
Tasks
Image CaptioningImage DescriptionMachine TranslationMultimodal Machine TranslationTranslationSimilar Papers 제목 키워드 기반
Integrating Translation Memories into Non-Autoregressive Machine Translation
Non-autoregressive machine translation (NAT) has recently made great progress. However, most works to date have focused on standard translation tasks, even though some edit-based NAT models, such as the Levenshtein Trans…
Knowledge DistillationMachine TranslationTranslationInvited Presentation
AI now and in future will have to grapple continuously with the problem of low resource. AI will increasingly be ML intensive. But ML needs data often with annotation. However, annotation is costly. Over the years, throu…
Machine TranslationNERSentiment AnalysisTranslationngram-OAXE: Phrase-Based Order-Agnostic Cross Entropy for Non-Autoregressive Machine Translation
Recently, a new training oaxe loss has proven effective to ameliorate the effect of multimodality for non-autoregressive translation (NAT), which removes the penalty of word order errors in the standard cross-entropy los…
Machine TranslationSentenceTranslationMultimodal Quality Estimation for Machine Translation
We propose approaches to Quality Estimation (QE) for Machine Translation that explore both text and visual modalities for Multimodal QE. We compare various multimodality integration and fusion strategies. For both senten…
Machine TranslationSentenceTranslationTagged Back-translation Revisited: Why Does It Really Work?
In this paper, we show that neural machine translation (NMT) systems trained on large back-translated data overfit some of the characteristics of machine-translated texts. Such NMT systems better translate human-produced…
Machine TranslationNMTTAGTranslation