paper-with-me

홈 › Papers

Constrained Paraphrase Consistency for LLM Hallucination Detection

2026-06-06 · Shanshan Lin, Dongsheng Hong, Sibo Ju, Chao Chen, Xi Zhang, Xiangwen Liao arxiv

Large language models (LLMs) can generate factually inconsistent claims, motivating accurate and scalable hallucination detectors. Prior work largely enlarges training sets via synthesis or new annotations, introducing increasing cost and potential bias while underusing the consistency implied by semantically equivalent paraphrases. We propose Consistency-Constrained Hallucination Detector (CCHD), which formulates training as a constrained optimization problem. The standard cross-entropy on original document-claim pairs is complemented by (i) paraphrase-consistency constraints bounding divergence across paraphrased views, and (ii) label-preservation constraints tying paraphrases to ground truth. We solve the problem by gradient descent-ascent over model parameters and per-view Lagrange multipliers, adding only a few scalar dual variables and no inference-time overhead. With DeBERTa and Flan-T5 backbones, CCHD consistently outperforms strong baselines (FactCG, MiniCheck, and AlignScore) on standard factuality benchmarks, demonstrating its superiority on hallucination detection.

📄 PDF Abstract BibTeX arXiv:2606.08158

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

BEACON: Behavioral Entropy Aggregation for Cross-Model Hallucination Detection in Large Language Models

2026-04-20 · Naveen Bera, Pulijala Sai Nikhila, Kondaguduru Abhiram, Shaik Gayaz Ali 외 arxiv

Hallucination in large language models (LLMs), defined as the generation of factually incorrect or unsupported content, remains a critical barrier to reliable deployment. We present BEACON (Behavioral Entropy Aggregation…

Feature Importance

HalluMat: Detecting Hallucinations in LLM-Generated Materials Science Content Through Multi-Stage Verification

2025-12-26 · Bhanu Prakash Vangala, Sajid Mahmud, Pawan Neupane, Joel Selvaraj 외 arxiv

Artificial Intelligence (AI), particularly Large Language Models (LLMs), is transforming scientific discovery, enabling rapid knowledge generation and hypothesis formulation. However, a critical challenge is hallucinatio…

SLM Meets LLM: Balancing Latency, Interpretability and Consistency in Hallucination Detection

2024-08-22 · Mengya Hu, Rui Xu, Deren Lei, Yaxi Li 외

Large language models (LLMs) are highly capable but face latency challenges in real-time applications, such as conducting online hallucination detection. To overcome this issue, we propose a novel framework that leverage…

HallucinationLanguage ModelingLanguage ModellingSmall Language Model

Hallucinations Live in Variance

2026-01-11 · Aaron R. Flouro, Shawn P. Chadwick arxiv

Benchmarks measure whether a model is correct. They do not measure whether a model is reliable. This distinction is largely academic for single-shot inference, but becomes critical for agentic AI systems, where a single …

SLPL SHROOM at SemEval2024 Task 06: A comprehensive study on models ability to detect hallucination

2024-04-07 · Pouya Fallah, Soroush Gooran, Mohammad Jafarinasab, Pouya Sadeghi 외

Language models, particularly generative models, are susceptible to hallucinations, generating outputs that contradict factual knowledge or the source text. This study explores methods for detecting hallucinations in thr…

HallucinationMachine TranslationParaphrase GenerationSemantic Similarity+1