paper-with-me

Papers

IdiomX A Multilingual Benchmark for Idiom Understanding, Retrieval, and Interpretation

2026-04-25 · Ayman Ali Sharara arxiv

Idiomatic expressions remain a persistent challenge for natural language processing because their meanings are often non-compositional, context-dependent, and difficult to align across languages. Existing idiom resources are often limited in scale, contextual diversity, or multilingual coverage, restricting their utility for modern language models. We introduce IdiomX, a large-scale multilingual benchmark for idiom understanding, retrieval, and interpretation, constructed through a reproducible multi-stage pipeline combining lexical resource extraction, large-scale normalization, controlled large language model enrichment, and structured validation. The resulting dataset contains over 190K contextualized examples spanning 12K+ idioms, with aligned English, Arabic, and French semantic representations, idiomatic and literal usage labels, and rich linguistic metadata. Building on this resource, we define a unified four-task benchmark covering idiom detection, context-to-idiom retrieval, Arabic-to-English idiom retrieval, and idiom interpretation, extending evaluation from figurative recognition to semantic grounding and explainable meaning retrieval. Experiments show that contextual transformer models substantially improve idiom detection, while hybrid retrieval and reranking architectures significantly strengthen both monolingual and cross-lingual idiom retrieval. Results further demonstrate that idiom interpretation can be effectively modeled as a semantic retrieval task, introducing interpretability as a complementary benchmark dimension. Overall, IdiomX provides a scalable benchmark for studying idiomatic language as a progression from detection to retrieval and semantic interpretation, and offers a modular framework extensible to additional languages and figurative reasoning tasks

📄 PDF Abstract BibTeX arXiv:2606.02584

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic Retrieval

Similar Papers 제목 키워드 기반

A Parallel Cross-Lingual Benchmark for Multimodal Idiomaticity Understanding

2026-01-13 · Dilara Torunoğlu-Selamet, Dogukan Arslan, Rodrigo Wilkens, Wei He 외 arxiv

Potentially idiomatic expressions (PIEs) construe meanings inherently tied to the everyday experience of a given language community. As such, they constitute an interesting challenge for assessing the linguistic (and to …

Memorization or Reasoning? Exploring the Idiom Understanding of LLMs

2025-05-22 · Jisu Kim, Youngwoo Shin, Uiji Hwang, Jihun Choi 외

Idioms have long posed a challenge due to their unique linguistic properties, which set them apart from other common expressions. While recent studies have leveraged large language models (LLMs) to handle idioms across v…

Machine TranslationMemorizationSentence

ID10M: Idiom Identification in 10 Languages

2022-07-01 · Findings (NAACL) 2022 7 · Simone Tedeschi, Federico Martelli, Roberto Navigli

Idioms are phrases which present a figurative meaning that cannot be (completely) derived by looking at the meaning of their individual components.Identifying and understanding idioms in context is a crucial goal and a k…

Natural Language Understanding

When Meaning Isn't Literal: Exploring Idiomatic Meaning Across Languages and Modalities

2026-04-12 · Sarmistha Das, Shreyas Guha, Suvrayan Bandyopadhyay, Salisa Phosit 외 arxiv

Idiomatic reasoning, deeply intertwined with metaphor and culture, remains a blind spot for contemporary language models, whose progress skews toward surface-level lexical and semantic cues. For instance, the Bengali idi…

When Words Don't Mean What They Say: Figurative Understanding in Bengali Idioms

2026-02-13 · Adib Sakhawat, Shamim Ara Parveen, Md Ruhul Amin, Shamim Al Mahmud 외 arxiv

Figurative language understanding remains a significant challenge for Large Language Models (LLMs), especially for low-resource languages. To address this, we introduce a new idiom dataset, a large-scale, culturally-grou…