paper-with-me

홈 › Papers

MIT-10M: A Large Scale Parallel Corpus of Multilingual Image Translation

2024-12-10 · Bo Li, Shaolin Zhu, Lijie Wen

Image Translation (IT) holds immense potential across diverse domains, enabling the translation of textual content within images into various languages. However, existing datasets often suffer from limitations in scale, diversity, and quality, hindering the development and evaluation of IT models. To address this issue, we introduce MIT-10M, a large-scale parallel corpus of multilingual image translation with over 10M image-text pairs derived from real-world data, which has undergone extensive data cleaning and multilingual translation validation. It contains 840K images in three sizes, 28 categories, tasks with three levels of difficulty and 14 languages image-text pairs, which is a considerable improvement on existing datasets. We conduct extensive experiments to evaluate and train models on MIT-10M. The experimental results clearly indicate that our dataset has higher adaptability when it comes to evaluating the performance of the models in tackling challenging and complex image translation tasks in the real world. Moreover, the performance of the model fine-tuned with MIT-10M has tripled compared to the baseline model, further confirming its superiority.

📄 PDF Abstract BibTeX arXiv:2412.07147

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityTranslation

Similar Papers 제목 키워드 기반

From Unaligned to Aligned: Scaling Multilingual LLMs with Multi-Way Parallel Corpora

2025-05-20 · Yingli Shen, Wen Lai, Shuo Wang, Kangyang Luo 외

Continued pretraining and instruction tuning on large-scale multilingual data have proven to be effective in scaling large language models (LLMs) to low-resource languages. However, the unaligned nature of such data limi…

YouTube-SL-25: A Large-Scale, Open-Domain Multilingual Sign Language Parallel Corpus

2024-07-15 · Garrett Tanzer, Biao Zhang

Even for better-studied sign languages like American Sign Language (ASL), data is the bottleneck for machine learning research. The situation is worse yet for the many other sign languages used by Deaf/Hard of Hearing co…

Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Mining

2021-05-21 · ACL 2020 6 · Ivana Kvapilikova, Mikel Artetxe, Gorka Labaka, Eneko Agirre 외

Existing models of multilingual sentence embeddings require large parallel data resources which are not available for low-resource languages. We propose a novel unsupervised method to derive multilingual sentence embeddi…

Language ModelingLanguage ModellingMachine TranslationParallel Corpus Mining+4

MITRA: A Large-Scale Parallel Corpus and Multilingual Pretrained Language Model for Machine Translation and Semantic Retrieval for Pāli, Sanskrit, Buddhist Chinese, and Tibetan

2026-01-10 · Sebastian Nehrdich, Kurt Keutzer arxiv

Ancient Buddhist literature features frequent, yet often unannotated, textual parallels spread across diverse languages: Sanskrit, Pāli, Buddhist Chinese, Tibetan, and more. The scale of this material makes manual examin…

Machine TranslationSemantic SimilaritySemantic Retrieval

SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations

2022-11-08 · arXiv 2022 10 · Paul-Ambroise Duquenne, Hongyu Gong, Ning Dong, Jingfei Du 외

We present SpeechMatrix, a large-scale multilingual corpus of speech-to-speech translations mined from real speech of European Parliament recordings. It contains speech alignments in 136 language pairs with a total of 41…

Mixture-of-ExpertsSpeech-to-Speech TranslationTranslation