paper-with-me

홈 › Papers

The Hallucinations Leaderboard -- An Open Effort to Measure Hallucinations in Large Language Models

2024-04-08 · Giwon Hong, Aryo Pradipta Gema, Rohit Saxena, Xiaotang Du, Ping Nie, Yu Zhao, Laura Perez-Beltrachini, Max Ryabinin, Xuanli He, Clémentine Fourrier, Pasquale Minervini

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do not align with factual reality or the input context. This paper introduces the Hallucinations Leaderboard, an open initiative to quantitatively measure and compare the tendency of each model to produce hallucinations. The leaderboard uses a comprehensive set of benchmarks focusing on different aspects of hallucinations, such as factuality and faithfulness, across various tasks, including question-answering, summarisation, and reading comprehension. Our analysis provides insights into the performance of different models, guiding researchers and practitioners in choosing the most reliable models for their applications.

📄 PDF Abstract BibTeX arXiv:2404.05904

Code (0)

등록된 구현이 없습니다.

Tasks

Question AnsweringReading Comprehension

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Benchmarking LLM Faithfulness in RAG with Evolving Leaderboards

2025-05-07 · Manveer Singh Tamber, Forrest Sheng Bao, Chenyu Xu, Ge Luo 외

Hallucinations remain a persistent challenge for LLMs. RAG aims to reduce hallucinations by grounding responses in contexts. However, even when provided context, LLMs still frequently introduce unsupported information or…

BenchmarkingHallucinationHallucination EvaluationRAG

MetaCheckGPT -- A Multi-task Hallucination Detector Using LLM Uncertainty and Meta-models

2024-04-10 · Rahul Mehta, Andrew Hoblitzell, Jack O'Keefe, Hyeju Jang 외

Hallucinations in large language models (LLMs) have recently become a significant problem. A recent effort in this direction is a shared task at Semeval 2024 Task 6, SHROOM, a Shared-task on Hallucinations and Related Ob…

Hallucination

OAEI-LLM-T: A TBox Benchmark Dataset for Understanding Large Language Model Hallucinations in Ontology Matching

2025-03-25 · Zhangcheng Qiang, Kerry Taylor, Weiqing Wang, Jing Jiang

Hallucinations are often inevitable in downstream tasks using large language models (LLMs). To tackle the substantial challenge of addressing hallucinations for LLM-based ontology matching (OM) systems, we introduce a ne…

Language ModelingLanguage ModellingLarge Language ModelOntology Matching

Why Language Models Hallucinate

2025-09-04 · Adam Tauman Kalai, Ofir Nachum, Santosh S. Vempala, Edwin Zhang arxiv

Like students facing hard exam questions, large language models sometimes guess when uncertain, producing plausible yet incorrect statements instead of admitting uncertainty. Such "hallucinations" persist even in state-o…

Binary Classification

CATCH: Complementary Adaptive Token-level Contrastive Decoding to Mitigate Hallucinations in LVLMs

2024-11-19 · Zhehan Kan, Ce Zhang, Zihan Liao, Yapeng Tian 외

Large Vision-Language Model (LVLM) systems have demonstrated impressive vision-language reasoning capabilities but suffer from pervasive and severe hallucination issues, posing significant risks in critical domains such …

HallucinationLanguage ModelingLanguage ModellingQuestion Answering+1