A Shared Task on Multimodal Machine Translation and Crosslingual Image Description
Code (0)
등록된 구현이 없습니다.
Tasks
Image DescriptionImage RetrievalMachine TranslationMultimodal Machine TranslationQuestion AnsweringTranslationVideo CaptioningVisual Question Answering (VQA)Similar Papers 제목 키워드 기반
MCIF: Multimodal Crosslingual Instruction-Following Benchmark from Scientific Talks
Recent advances in large language models have laid the foundation for multimodal LLMs (MLLMs), which unify text, speech, and vision within a single framework. As these models are rapidly evolving toward general-purpose i…
Instruction FollowingQuestion AnsweringMultimodal Pivots for Image Caption Translation
We present an approach to improve statistical machine translation of image descriptions by multimodal pivots defined in visual space. The key idea is to perform image retrieval over a database of images that are captione…
Image RetrievalMachine TranslationRerankingRetrieval+1Fully Unsupervised Crosslingual Semantic Textual Similarity Metric Based on BERT for Identifying Parallel Data
We present a fully unsupervised crosslingual semantic textual similarity (STS) metric, based on contextual embeddings extracted from BERT {--} Bidirectional Encoder Representations from Transformers (Devlin et al., 2019)…
Machine TranslationNatural Language UnderstandingSemantic Textual SimilaritySTS+1Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description
We present the results from the second shared task on multimodal machine translation and multilingual image description. Nine teams submitted 19 systems to two tasks. The multimodal translation task, in which the source …
Image DescriptionMachine TranslationMultimodal Machine TranslationSentence+1Crosslingual Capabilities and Knowledge Barriers in Multilingual Large Language Models
Large language models (LLMs) are typically multilingual due to pretraining on diverse multilingual corpora. But can these models relate corresponding concepts across languages, effectively being crosslingual? This study …
Machine TranslationMMLUTransfer Learning