Towards Global AI Inclusivity: A Large-Scale Multilingual Terminology Dataset (GIST)

2024-12-24 · Jiarui Liu, Iman Ouzzani, Wenkai Li, Lechen Zhang, Tianyue Ou, Houda Bouamor, Zhijing Jin, Mona Diab

The field of machine translation has achieved significant advancements, yet domain-specific terminology translation, particularly in AI, remains challenging. We introduce GIST, a large-scale multilingual AI terminology dataset containing 5K terms extracted from top AI conference papers spanning 2000 to 2023. The terms are translated into Arabic, Chinese, French, Japanese, and Russian using a hybrid framework that combines LLMs for extraction with human expertise for translation. The dataset's quality is benchmarked against existing resources, demonstrating superior translation accuracy through crowdsourced evaluation. GIST is integrated into translation workflows using post-translation refinement methods that require no retraining, where LLM prompting consistently improves BLEU and COMET scores. A web demonstration on the ACL Anthology platform highlights its practical application, showcasing improved accessibility for non-English speakers. This work aims to address critical gaps in AI terminology resources and fosters global inclusivity and collaboration in AI research.

📄 PDF Abstract BibTeX arXiv:2412.18367

Code (1)

jiarui-liu/multilingualaiterminology 공식 구현 pytorch

Tasks

Machine Translation Translation

Bridging the Language Gap: Enhancing Multilingual Prompt-Based Code Generation in LLMs via Zero-Shot Cross-Lingual Transfer

2024-08-19 · Mingda Li, Abhijit Mishra, Utkarsh Mujumdar

The use of Large Language Models (LLMs) for program code generation has gained substantial attention, but their biases and limitations with non-English prompts challenge global inclusivity. This paper investigates the co…

Code Generation Cross-Lingual Transfer Data Augmentation mbpp+1

CulFiT: A Fine-grained Cultural-aware LLM Training Paradigm via Multilingual Critique Data Synthesis

2025-05-26 · Ruixiang Feng, Shen Gao, Xiuying Chen, Lisi Chen 외

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks, yet they often exhibit a specific cultural biases, neglecting the values and linguistic diversity of low-resource regions. This…

Diversity Open-Ended Question Answering Question Answering

The AI Language Proficiency Monitor -- Tracking the Progress of LLMs on Multilingual Benchmarks

2025-07-11 · David Pomerenke, Jonas Nothnagel, Simon Ostermann arxiv

To ensure equitable access to the benefits of large language models (LLMs), it is essential to evaluate their capabilities across the world's languages. We introduce the AI Language Proficiency Monitor, a comprehensive m…

Question Answering

From Knowledge to Inference: Formalizing Specialized Public Health Reasoning on GlobalHealthAtlas

2026-01-31 · Zhaokun Yan, Shan Xu, Wuzheng Dong, Zhaohan Liu 외 arxiv

Public health reasoning requires population level inference grounded in scientific evidence, expert consensus, and safety constraints. However, it remains underexplored as a structured machine learning problem with limit…

Building from Scratch: A Multi-Agent Framework with Human-in-the-Loop for Multilingual Legal Terminology Mapping

2025-12-15 · Lingyi Meng, Maolin Liu, Hao Wang, Yilan Cheng 외 arxiv

Accurately mapping legal terminology across languages remains a significant challenge, especially for language pairs like Chinese and Japanese, which share a large number of homographs with different meanings. Existing r…