paper-with-me

홈 › Papers

Graphing the Truth: Structured Visualizations for Automated Hallucination Detection in LLMs

2025-11-29 · Tanmay Agrawal arxiv

Large Language Models have rapidly advanced in their ability to interpret and generate natural language. In enterprise settings, they are frequently augmented with closed-source domain knowledge to deliver more contextually informed responses. However, operational constraints such as limited context windows and inconsistencies between pre-training data and supplied knowledge often lead to hallucinations, some of which appear highly credible and escape routine human review. Current mitigation strategies either depend on costly, large-scale gold-standard Q\&A curation or rely on secondary model verification, neither of which offers deterministic assurance. This paper introduces a framework that organizes proprietary knowledge and model-generated content into interactive visual knowledge graphs. The objective is to provide end users with a clear, intuitive view of potential hallucination zones by linking model assertions to underlying sources of truth and indicating confidence levels. Through this visual interface, users can diagnose inconsistencies, identify weak reasoning chains, and supply corrective feedback. The resulting human-in-the-loop workflow creates a structured feedback loop that can enhance model reliability and continuously improve response quality.

📄 PDF Abstract BibTeX arXiv:2512.00663

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Graphs

Similar Papers 제목 키워드 기반

MathViz-E: A Case-study in Domain-Specialized Tool-Using Agents

2024-07-24 · Arya Bulusu, Brandon Man, Ashish Jagmohan, Aditya Vempaty 외

There has been significant recent interest in harnessing LLMs to control software systems through multi-step reasoning, planning and tool-usage. While some promising results have been obtained, application to specific do…

Math

LLM-based Triplet Extraction from Financial Reports

2026-02-12 · Dante Wesslund, Ville Stenström, Pontus Linde, Alexander Holmberg arxiv

Corporate financial reports are a valuable source of structured knowledge for Knowledge Graph construction, but the lack of annotated ground truth in this domain makes evaluation difficult. We present a semi-automated pi…

Coreference Resolution

The Truth, the Whole Truth, and Nothing but the Truth: Automatic Visualization Evaluation from Reconstruction Quality

2026-01-26 · Roxana Bujack, Li-Ta Lo, Ethan Stam, Ayan Biswas 외 arxiv

Recent advances in AI enable the automatic generation of visualizations directly from textual prompts using agentic workflows. However, visualizations produced via one-shot generative methods often suffer from insufficie…

HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detection

2024-09-26 · Xuefeng Du, Chaowei Xiao, Yixuan Li

The surge in applications of large language models (LLMs) has prompted concerns about the generation of misleading or fabricated information, known as hallucinations. Therefore, detecting hallucinations has become critic…

Hallucination

StructText: A Synthetic Table-to-Text Approach for Benchmark Generation with Multi-Dimensional Evaluation

2025-07-28 · Satyananda Kashyap, Sola Shirai, Nandana Mihindukulasooriya, Horst Samulowitz arxiv

Extracting structured information from text, such as key-value pairs that could augment tabular data, is quite useful in many enterprise use cases. Although large language models (LLMs) have enabled numerous automated pi…