WAT2019: English-Hindi Translation on Hindi Visual Genome Dataset
A multimodal translation is a task of translating a source language to a target language with the help of a parallel text corpus paired with images that represent the contextual details of the text. In this paper, we carried out an extensive comparison to evaluate the benefits of using a multimodal approach on translating text in English to a low resource language, Hindi as a part of WAT2019 shared task. We carried out the translation of English to Hindi in three separate tasks with both the evaluation and challenge dataset. First, by using only the parallel text corpora, then through an image caption generation approach and, finally with the multimodal approach. Our experiment shows a significant improvement in the result with the multimodal approach than the other approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Caption GenerationTranslationSimilar Papers 제목 키워드 기반
Hindi Visual Genome: A Dataset for Multimodal English-to-Hindi Machine Translation
Visual Genome is a dataset connecting structured image information with English language. We present ``Hindi Visual Genome'', a multimodal dataset consisting of text and images suitable for English-Hindi multimodal machi…
Machine TranslationMultimodal Machine TranslationTranslationAn encoder-decoder based framework for hindi image caption generation
In recent times, research activity on image caption generation has attracted several researchers. The present work attempt to address the problem of Hindi image caption generation using Hindi Visual genome dataset. Hindi…
Caption GenerationDecoderHindi Image CaptioningImage CaptioningEnglish to Hindi Multi-modal Neural Machine Translation and Hindi Image Captioning
With the widespread use of Machine Trans-lation (MT) techniques, attempt to minimizecommunication gap among people from di-verse linguistic backgrounds. We have par-ticipated in Workshop on Asian Transla-tion 2019 (WAT20…
Hindi Image CaptioningImage CaptioningMachine TranslationNMT+1Andha-Dhun: A First Look at Audio Descriptions in Hindi
Audio Descriptions (ADs) narrate visual content for Blind and Low Vision (BLV) audiences during gaps in audiovisual media. There is growing momentum around ADs in movies and TV shows, and with mandates from India's Centr…
Machine TranslationComparing Recurrent and Convolutional Architectures for English-Hindi Neural Machine Translation
In this paper, we empirically compare the two encoder-decoder neural machine translation architectures: convolutional sequence to sequence model (ConvS2S) and recurrent sequence to sequence model (RNNS2S) for English-Hin…
DecoderImage CaptioningLanguage ModelingLanguage Modelling+4