Quantifying Genuine Awareness in Hallucination Prediction Beyond Question-Side Shortcuts
Many works have proposed methodologies for language model (LM) hallucination detection and reported seemingly strong performance. However, we argue that the reported performance to date reflects not only a model's genuine awareness of its internal information, but also awareness derived purely from question-side information (e.g., benchmark hacking). While benchmark hacking can be effective for boosting hallucination detection score on existing benchmarks, it does not generalize to out-of-domain settings and practical usage. Nevertheless, disentangling how much of a model's hallucination detection performance arises from question-side awareness is non-trivial. To address this, we propose a methodology for measuring this effect without requiring human labor, Approximate Question-side Effect (AQE). Our analysis using AQE reveals that existing hallucination detection methods rely heavily on benchmark hacking.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Don't Fight Hallucinations, Use Them: Estimating Image Realism using NLI over Atomic Facts
Quantifying the realism of images remains a challenging problem in the field of artificial intelligence. For example, an image of Albert Einstein holding a smartphone violates common-sense because modern smartphone were …
Common Sense ReasoningNatural Language InferenceFakes of Varying Shades: How Warning Affects Human Perception and Engagement Regarding LLM Hallucinations
The widespread adoption and transformative effects of large language models (LLMs) have sparked concerns regarding their capacity to produce inaccurate and fictitious content, referred to as `hallucinations'. Given the p…
HallucinationHuman DetectionSurveyAI Hallucination from Students' Perspective: A Thematic Analysis
As students increasingly rely on large language models, hallucinations pose a growing threat to learning. To mitigate this, AI literacy must expand beyond prompt engineering to address how students should detect and resp…
Prompt EngineeringMitigating Low-Level Visual Hallucinations Requires Self-Awareness: Database, Model and Training Strategy
The rapid development of multimodal large language models has resulted in remarkable advancements in visual perception and understanding, consolidating several tasks into a single visual question-answering framework. How…
HallucinationImage CaptioningImage Quality AssessmentQuestion Answering+1Revisiting Hallucination Detection with Effective Rank-based Uncertainty
Detecting hallucinations in large language models (LLMs) remains a fundamental challenge for their trustworthy deployment. Going beyond basic uncertainty-driven hallucination detection frameworks, we propose a simple yet…