paper-with-me

홈 › Papers

CIP: A Plug-and-Play Causal Prompting Framework for Mitigating Hallucinations under Long-Context Noise

2025-12-12 · Qingsen Ma, Dianyun Wang, Ran Jing, Yujun Sun, Zhenbo Xu arxiv

Large language models often hallucinate when processing long and noisy retrieval contexts because they rely on spurious correlations rather than genuine causal relationships. We propose CIP, a lightweight and plug-and-play causal prompting framework that mitigates hallucinations at the input stage. CIP constructs a causal relation sequence among entities, actions, and events and injects it into the prompt to guide reasoning toward causally relevant evidence. Through causal intervention and counterfactual reasoning, CIP suppresses non causal reasoning paths, improving factual grounding and interpretability. Experiments across seven mainstream language models, including GPT-4o, Gemini 2.0 Flash, and Llama 3.1, show that CIP consistently enhances reasoning quality and reliability, achieving 2.6 points improvement in Attributable Rate, 0.38 improvement in Causal Consistency Score, and a fourfold increase in effective information density. API level profiling further shows that CIP accelerates contextual understanding and reduces end to end response latency by up to 55.1 percent. These results suggest that causal reasoning may serve as a promising paradigm for improving the explainability, stability, and efficiency of large language models.

📄 PDF Abstract BibTeX arXiv:2512.11282

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Advancing Edge Classification through High-Dimensional Causal Modeling of Node-Edge Interplay

2026-05-01 · Duanyu Feng, Li Ding, Hongru Liang, Wenqiang Lei arxiv

Edge classification, a crucial task for graph applications, remains relatively under-explored compared to link prediction. Current methods often overlook the potential causal influences of node features on edge features,…

Graph Neural NetworkCausal InferenceLink Prediction

Mitigating Forgetting Between Supervised and Reinforcement Learning Yields Stronger Reasoners

2025-10-06 · Xiangchi Yuan, Xiang Chen, Tong Yu, Dachuan Shi 외 arxiv

Large Language Models (LLMs) show strong reasoning abilities, often amplified by Chain-of-Thought (CoT) prompting and reinforcement learning (RL). Although RL algorithms can substantially improve reasoning, they struggle…

Reinforcement Learning

Causal-CoG: A Causal-Effect Look at Context Generation for Boosting Multi-modal Language Models

2023-12-09 · CVPR 2024 1 · Shitian Zhao, Zhuowan Li, Yadong Lu, Alan Yuille 외

While Multi-modal Language Models (MLMs) demonstrate impressive multimodal ability, they still struggle on providing factual and precise responses for tasks like visual question answering (VQA). In this paper, we address…

Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Mitigating Modality Prior-Induced Hallucinations in Multimodal Large Language Models via Deciphering Attention Causality

2024-10-07 · Guanyu Zhou, Yibo Yan, Xin Zou, Kun Wang 외

Multimodal Large Language Models (MLLMs) have emerged as a central focus in both industry and academia, but often suffer from biases introduced by visual and language priors, which can lead to multimodal hallucination. T…

Causal InferencecounterfactualCounterfactual ReasoningHallucination+4

Unbiased Reasoning for Knowledge-Intensive Tasks in Large Language Models via Conditional Front-Door Adjustment

2025-08-23 · Bo Zhao, Yinghao Zhang, Ziqi Xu, Yongli Ren 외 arxiv

Large Language Models (LLMs) have shown impressive capabilities in natural language processing but still struggle to perform well on knowledge-intensive tasks that require deep reasoning and the integration of external k…