paper-with-me

홈 › Papers

Chain of Natural Language Inference for Reducing Large Language Model Ungrounded Hallucinations

2023-10-06 · Deren Lei, Yaxi Li, Mengya Hu, Mingyu Wang, Vincent Yun, Emily Ching, Eslam Kamal

Large language models (LLMs) can generate fluent natural language texts when given relevant documents as background context. This ability has attracted considerable interest in developing industry applications of LLMs. However, LLMs are prone to generate hallucinations that are not supported by the provided sources. In this paper, we propose a hierarchical framework to detect and mitigate such ungrounded hallucination. Our framework uses Chain of Natural Language Inference (CoNLI) for hallucination detection and hallucination reduction via post-editing. Our approach achieves state-of-the-art performance on hallucination detection and enhances text quality through rewrite, using LLMs without any fine-tuning or domain-specific prompt engineering. We show that this simple plug-and-play framework can serve as an effective choice for hallucination detection and reduction, achieving competitive performance across various contexts.

📄 PDF Abstract BibTeX arXiv:2310.03951

Code (1)

microsoft/conli_hallucination 공식 구현

Tasks

HallucinationLanguage ModelingLanguage ModellingLarge Language ModelNatural Language InferencePrompt Engineering

Similar Papers 제목 키워드 기반

SEME at SemEval-2024 Task 2: Comparing Masked and Generative Language Models on Natural Language Inference for Clinical Trials

2024-04-05 · Mathilde Aguiar, Pierre Zweigenbaum, Nona Naderi

This paper describes our submission to Task 2 of SemEval-2024: Safe Biomedical Natural Language Inference for Clinical Trials. The Multi-evidence Natural Language Inference for Clinical Trial Data (NLI4CT) consists of a …

Natural Language InferenceTask 2

Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual Hallucination

2024-11-15 · Haojie Zheng, Tianyang Xu, Hanchi Sun, Shu Pu 외

Multimodal large language models (MLLMs) have advanced the integration of visual and linguistic modalities, establishing themselves as the dominant paradigm for visual-language tasks. Current approaches like chain of tho…

HallucinationMultimodal Reasoning

ThinkLess: A Training-Free Inference-Efficient Method for Reducing Reasoning Redundancy

2025-05-21 · Gengyang Li, Yifeng Gao, Yuming Li, Yunfang Wu

While Chain-of-Thought (CoT) prompting improves reasoning in large language models (LLMs), the excessive length of reasoning tokens increases latency and KV cache memory usage, and may even truncate final answers under c…

Instruction FollowingTransfer Learning

CodeBC: A More Secure Large Language Model for Smart Contract Code Generation in Blockchain

2025-04-28 · LingXiang Wang, Hainan Zhang, Qinnan Zhang, Ziwei Wang 외

Large language models (LLMs) excel at generating code from natural language instructions, yet they often lack an understanding of security vulnerabilities. This limitation makes it difficult for LLMs to avoid security ri…

Code GenerationLanguage ModelingLanguage ModellingLarge Language Model

Chain-of-Query: Unleashing the Power of LLMs in SQL-Aided Table Understanding via Multi-Agent Collaboration

2025-08-14 · Songyuan Sui, Hongyi Liu, Serena Liu, Li Li 외 arxiv

Table understanding requires structured, multi-step reasoning. Large Language Models (LLMs) struggle with it due to the structural complexity of tabular data. Recently, multi-agent frameworks for SQL generation have show…