paper-with-me

Papers

LLMs Should Not Yet Be Credited with Decision Explanation

2026-05-01 · Wenshuo Wang arxiv

This position paper argues that LLMs should not yet be credited with decision explanation. This matters because recent work increasingly treats accurate behavioral prediction, plausible rationales, and outcome-conditioned reasoning traces as evidence that LLMs explain why people decide as they do, risking a premature redefinition of what counts as explanatory progress in human decision modeling. We first distinguish three claims with different evidential burdens: decision prediction, rationale generation, and decision explanation. We then argue that the evidence most commonly offered for LLM-based decision accounts directly supports the first two claims, and sometimes explanatory hypothesis generation, but does not distinguish decision explanation from prediction-supportive rationalization. Next, we propose a bridge standard for decision-explanation credit: stronger claims should specify explanatory targets, discriminate against weaker rationalizer alternatives, use target-appropriate process- or intervention-sensitive validation, and bound their scope. We then situate this standard against competing views and related literatures, clarifying why it preserves the value of LLMs as predictors, narrators, and hypothesis generators while resisting premature explanatory credit. We conclude with a principle of credit calibration: LLMs should be credited for the strongest claim their evidence warrants, and no stronger; if adopted, this principle can help turn LLMs from persuasive narrators of decisions into more reliable instruments for discovering, testing, and communicating explanations of human behavior.

📄 PDF Abstract BibTeX arXiv:2605.01164

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Visual Credit Audit for Multimodal Spatial Reasoning

2026-07-29 · Feixiang Liu, Qiang Qiu, Lanbo Sun, Nan Wei 외 arxiv

Closed yes/no spatial benchmarks can reward a correct answer even when the image adds little support beyond no-image contexts. Under a fixed forced-choice interface, Visual Credit Audit (VCA) separates two estimands: whe…

Spatial Reasoning

LLMs for Explainable Business Decision-Making: A Reinforcement Learning Fine-Tuning Approach

2025-12-10 · Xiang Cheng, Wen Wang, Anindya Ghose arxiv

Artificial Intelligence (AI) models increasingly drive high-stakes consumer interactions, yet their decision logic often remains opaque. Prevailing explainable AI techniques rely on post hoc numerical feature attribution…

Reinforcement Learning

Towards Consistent Natural-Language Explanations via Explanation-Consistency Finetuning

2024-01-25 · Yanda Chen, Chandan Singh, Xiaodong Liu, Simiao Zuo 외

Large language models (LLMs) often generate convincing, fluent explanations. However, different from humans, they often generate inconsistent explanations on different inputs. For example, an LLM may generate the explana…

Question Answering

Large Language Models Help Humans Verify Truthfulness -- Except When They Are Convincingly Wrong

2023-10-19 · Chenglei Si, Navita Goyal, Sherry Tongshuang Wu, Chen Zhao 외

Large Language Models (LLMs) are increasingly used for accessing information on the web. Their truthfulness and factuality are thus of great interest. To help users make the right decisions about the information they get…

Fact CheckingInformation Retrieval

Do Models Explain Themselves? Counterfactual Simulatability of Natural Language Explanations

2023-07-17 · Yanda Chen, Ruiqi Zhong, Narutatsu Ri, Chen Zhao 외

Large language models (LLMs) are trained to imitate humans to explain human decisions. However, do LLMs explain themselves? Can they help humans build mental models of how LLMs process different inputs? To answer these q…

counterfactual