paper-with-me

Papers

Debiasing Large Language Models via Adaptive Causal Prompting with Sketch-of-Thought

2026-01-13 · Bowen Li, Ziqi Xu, Jing Ren, Renqiang Luo, Xikun Zhang, Xiuzhen Zhang, Yongli Ren, Feng Xia arxiv

Despite notable advancements in prompting methods for Large Language Models (LLMs), such as Chain-of-Thought (CoT), existing strategies still suffer from excessive token usage and limited generalisability across diverse reasoning tasks. To address these limitations, we propose an Adaptive Causal Prompting with Sketch-of-Thought (ACPS) framework, which leverages structural causal models to infer the causal effect of a query on its answer and adaptively select an appropriate intervention (i.e., standard front-door and conditional front-door adjustments). This design enables generalisable causal reasoning across heterogeneous tasks without task-specific retraining. By replacing verbose CoT with concise Sketch-of-Thought, ACPS enables efficient reasoning that significantly reduces token usage and inference cost. Extensive experiments on multiple reasoning benchmarks and LLMs demonstrate that ACPS consistently outperforms existing prompting baselines in terms of accuracy, robustness, and computational efficiency.

📄 PDF Abstract BibTeX arXiv:2601.08108

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Similar Papers 제목 키워드 기반

Causal Prompting: Debiasing Large Language Model Prompting based on Front-Door Adjustment

2024-03-05 · Congzhi Zhang, Linhai Zhang, Jialong Wu, Yulan He 외

Despite the notable advancements of existing prompting methods, such as In-Context Learning and Chain-of-Thought for Large Language Models (LLMs), they still face challenges related to various biases. Traditional debiasi…

Contrastive LearningData AugmentationIn-Context LearningLanguage Modeling+2

Steering LLMs Towards Unbiased Responses: A Causality-Guided Debiasing Framework

2024-03-13 · Jingling Li, Zeyu Tang, Xiaoyu Liu, Peter Spirtes 외

Large language models (LLMs) can easily generate biased and discriminative responses. As LLMs tap into consequential decision-making (e.g., hiring and healthcare), it is of crucial importance to develop strategies to mit…

Decision Making

Test-Time Fairness and Robustness in Large Language Models

2024-06-11 · Leonardo Cotta, Chris J. Maddison

Frontier Large Language Models (LLMs) can be socially discriminatory or sensitive to spurious features of their inputs. Because only well-resourced corporations can train frontier LLMs, we need robust test-time strategie…

Causal InferencecounterfactualData AugmentationDecision Making+3

Beyond Spurious Signals: Debiasing Multimodal Large Language Models via Counterfactual Inference and Adaptive Expert Routing

2025-09-18 · Zichen Wu, Hsiu-Yuan Huang, Yunfang Wu arxiv

Multimodal Large Language Models (MLLMs) have shown substantial capabilities in integrating visual and textual information, yet frequently rely on spurious correlations, undermining their robustness and generalization in…

Multimodal ReasoningSentiment AnalysisSarcasm Detection

Debiasing LLMs by Masking Unfairness-Driving Attention Heads

2025-10-11 · Tingxu Han, Wei Song, Ziqi Ding, Ziming Li 외 arxiv

Large language models (LLMs) increasingly mediate decisions in domains where unfair treatment of demographic groups is unacceptable. Existing work probes when biased outputs appear, but gives little insight into the mech…