paper-with-me

Papers

Incentives or Ontology? A Structural Rebuttal to OpenAI's Hallucination Thesis

2025-12-16 · Richard Ackermann, Simeon Emanuilov arxiv

OpenAI has recently argued that hallucinations in large language models result primarily from misaligned evaluation incentives that reward confident guessing rather than epistemic humility. On this view, hallucination is a contingent behavioral artifact, remediable through improved benchmarks and reward structures. In this paper, we challenge that interpretation. Drawing on previous work on structural hallucination and empirical experiments using a Licensing Oracle, we argue that hallucination is not an optimization failure but an architectural inevitability of the transformer model. Transformers do not represent the world; they model statistical associations among tokens. Their embedding spaces form a pseudo-ontology derived from linguistic co-occurrence rather than world-referential structure. At ontological boundary conditions - regions where training data is sparse or incoherent - the model necessarily interpolates fictional continuations in order to preserve coherence. No incentive mechanism can modify this structural dependence on pattern completion. Our empirical results demonstrate that hallucination can only be eliminated through external truth-validation and abstention modules, not through changes to incentives, prompting, or fine-tuning. The Licensing Oracle achieves perfect abstention precision across domains precisely because it supplies grounding that the transformer lacks. We conclude that hallucination is a structural property of generative architectures and that reliable AI requires hybrid systems that distinguish linguistic fluency from epistemic responsibility.

📄 PDF Abstract BibTeX arXiv:2512.14801

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Paper2Rebuttal: A Multi-Agent Framework for Transparent Author Response Assistance

2026-01-20 · Qianli Ma, Chang Guo, Zhiheng Tian, Siyu Wang 외 arxiv

Writing effective rebuttals is a high-stakes task that demands more than linguistic fluency, as it requires precise alignment between reviewer intent and manuscript details. Current solutions typically treat this as a di…

Text Generation

InternReviewer & InternAdvocate: Objective Reward and Evaluation for Agentic Reinforcement Learning in Peer Review and Rebuttal

2026-07-21 · Xuerui Su, Liya Guo, Qizhi Pei, Qipeng Guo 외 hf

Generating professional scholarly content, such as peer reviews and rebuttals, requires an intricate synergy between domain reasoning and factual grounding. This work presents a comprehensive framework for the developmen…

Feedback Indices to Evaluate LLM Responses to Rebuttals for Multiple Choice Type Questions

2026-01-02 · Justin C. Dunlap, Anne-Simone Parent, Ralf Widenhorn arxiv

We present a systematic framework of indices designed to characterize Large Language Model (LLM) responses when challenged with rebuttals during a chat. Assessing how LLMs respond to user dissent is crucial for understan…

Ontology Generation using Large Language Models

2025-03-07 · Anna Sofia Lippolis, Mohammad Javad Saeedizade, Robin Keskisärkkä, Sara Zuppiroli 외

The ontology engineering process is complex, time-consuming, and error-prone, even for experienced ontology engineers. In this work, we investigate the potential of Large Language Models (LLMs) to provide effective OWL o…

Handling Ontology Gaps in Semantic Parsing

2024-06-27 · Andrea Bacciu, Marco Damonte, Marco Basaldella, Emilio Monti

The majority of Neural Semantic Parsing (NSP) models are developed with the assumption that there are no concepts outside the ones such models can represent with their target symbols (closed-world assumption). This assum…

HallucinationQuestion AnsweringSemantic Parsing