paper-with-me

홈 › Papers

TRUE: A Trustworthy Unified Explanation Framework for Large Language Model Reasoning

2026-02-21 · Yujiao Yang arxiv

Large language models (LLMs) have demonstrated strong capabilities in complex reasoning tasks, yet their decision-making processes remain difficult to interpret. Existing explanation methods often lack trustworthy structural insight and are limited to single-instance analysis, failing to reveal reasoning stability and systematic failure mechanisms. To address these limitations, we propose the Trustworthy Unified Explanation Framework (TRUE), which integrates executable reasoning verification, feasible-region directed acyclic graph (DAG) modeling, and causal failure mode analysis. At the instance level, we redefine reasoning traces as executable process specifications and introduce blind execution verification to assess operational validity. At the local structural level, we construct feasible-region DAGs via structure-consistent perturbations, enabling explicit characterization of reasoning stability and the executable region in the local input space. At the class level, we introduce a causal failure mode analysis method that identifies recurring structural failure patterns and quantifies their causal influence using Shapley values. Extensive experiments across multiple reasoning benchmarks demonstrate that the proposed framework provides multi-level, verifiable explanations, including executable reasoning structures for individual instances, feasible-region representations for neighboring inputs, and interpretable failure modes with quantified importance at the class level. These results establish a unified and principled paradigm for improving the interpretability and reliability of LLM reasoning systems.

📄 PDF Abstract BibTeX arXiv:2602.18905

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Trustworthy Image Authentication using Forensic Knowledge Graphs

2026-06-22 · Tai D. Nguyen, Matthew C. Stamm arxiv

Advances in generative AI have made image falsification highly realistic, demanding trustworthy authentication systems. Existing forensic detectors can target certain forgery types but lack interpretability, while vision…

Knowledge Graphs

To Trust or Not to Trust a Regressor: Estimating and Explaining Trustworthiness of Regression Predictions

2021-04-14 · Kim de Bie, Ana Lucic, Hinda Haned

In hybrid human-AI systems, users need to decide whether or not to trust an algorithmic prediction while the true error in the prediction is unknown. To accommodate such settings, we introduce RETRO-VIZ, a method for (i)…

Predictionregression

PILAR: Personalizing Augmented Reality Interactions with LLM-based Human-Centric and Trustworthy Explanations for Daily Use Cases

2025-12-19 · Ripan Kumar Kundu, Istiak Ahmed, Khaza Anuarul Hoque arxiv

Artificial intelligence (AI)-driven augmented reality (AR) systems are becoming increasingly integrated into daily life, and with this growth comes a greater need for explainability in real-time user interactions. Tradit…

Real-Time Object Detection

Towards Large Language Models with Self-Consistent Natural Language Explanations

2025-06-09 · Sahar Admoni, Ofra Amir, Assaf Hallak, Yftah Ziser

Large language models (LLMs) seem to offer an easy path to interpretability: just ask them to explain their decisions. Yet, studies show that these post-hoc explanations often misrepresent the true decision process, as r…

Feature Importance

Boundary-Aware Uncertainty for Feature Attribution Explainers

2022-10-05 · Davin Hill, Aria Masoomi, Max Torop, Sandesh Ghimire 외

Post-hoc explanation methods have become a critical tool for understanding black-box classifiers in high-stakes applications. However, high-performing classifiers are often highly nonlinear and can exhibit complex behavi…