Enhancing Hallucination Detection through Perturbation-Based Synthetic Data Generation in System Responses
Detecting hallucinations in large language model (LLM) outputs is pivotal, yet traditional fine-tuning for this classification task is impeded by the expensive and quickly outdated annotation process, especially across numerous vertical domains and in the face of rapid LLM advancements. In this study, we introduce an approach that automatically generates both faithful and hallucinated outputs by rewriting system responses. Experimental findings demonstrate that a T5-base model, fine-tuned on our generated dataset, surpasses state-of-the-art zero-shot detectors and existing synthetic generation methods in both accuracy and latency, indicating efficacy of our approach.
Code (1)
Tasks
HallucinationLanguage ModelingLanguage ModellingLarge Language ModelSynthetic Data GenerationSimilar Papers 제목 키워드 기반
Enhancing object detection robustness: A synthetic and natural perturbation approach
Robustness against real-world distribution shifts is crucial for the successful deployment of object detection models in practical applications. In this paper, we address the problem of assessing and enhancing the robust…
Data AugmentationObjectobject-detectionObject DetectionDiving Deep into Modes of Fact Hallucinations in Dialogue Systems
Knowledge Graph(KG) grounded conversations often use large pre-trained models and usually suffer from fact hallucination. Frequently entities with no references in knowledge sources and conversation history are introduce…
HallucinationLyapunov Probes for Hallucination Detection in Large Foundation Models
We address hallucination detection in Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) by framing the problem through the lens of dynamical systems stability theory. Rather than treating hallucin…
What Makes LVLMs Hallucinate Less? Unveiling the Architectural Factors Behind Hallucination Robustness
Hallucination remains one of the key challenges undermining the reliability of Large Vision-Language Models (LVLMs). But what makes an LVLM hallucinate less? Many existing efforts focus on improving internal components o…
Vision-Amplified Semantic Entropy for Hallucination Detection in Medical Visual Question Answering
Multimodal large language models (MLLMs) have demonstrated significant potential in medical Visual Question Answering (VQA). Yet, they remain prone to hallucinations-incorrect responses that contradict input images, posi…
DiagnosticHallucinationMedical Visual Question AnsweringQuestion Answering+2