paper-with-me

Papers

Eliminating The Impossible, Whatever Remains Must Be True

2022-06-20 · Jinqiang Yu, Alexey Ignatiev, Peter J. Stuckey, Nina Narodytska, Joao Marques-Silva

The rise of AI methods to make predictions and decisions has led to a pressing need for more explainable artificial intelligence (XAI) methods. One common approach for XAI is to produce a post-hoc explanation, explaining why a black box ML model made a certain prediction. Formal approaches to post-hoc explanations provide succinct reasons for why a prediction was made, as well as why not another prediction was made. But these approaches assume that features are independent and uniformly distributed. While this means that "why" explanations are correct, they may be longer than required. It also means the "why not" explanations may be suspect as the counterexamples they rely on may not be meaningful. In this paper, we show how one can apply background knowledge to give more succinct "why" formal explanations, that are presumably easier to interpret by humans, and give more accurate "why not" explanations. In addition, we show how to use existing rule induction techniques to efficiently extract background information from a dataset, and also how to report which background information was used to make an explanation, allowing a human to examine it if they doubt the correctness of the explanation.

📄 PDF Abstract BibTeX arXiv:2206.09551

Code (1)

jinqiang-yu/xcon22 공식 구현 pytorch

Tasks

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Prediction

Similar Papers 제목 키워드 기반

Illustrating a neural model of logic computations: The case of Sherlock Holmes' old maxim

2012-10-28 · Eduardo Mizraji

Natural languages can express some logical propositions that humans are able to understand. We illustrate this fact with a famous text that Conan Doyle attributed to Holmes: 'It is an old maxim of mine that when you have…

Transfinite Modal Logic: a Semi-quantitative Explanation for Bayesian Reasoning

2022-04-02 · Xinyu Wang

Bayesian reasoning plays a significant role both in human rationality and in machine learning. In this paper, we introduce transfinite modal logic, which combines modal logic with ordinal arithmetic, in order to formaliz…

Whatever Remains Must Be True: Filtering Drives Reasoning in LLMs, Shaping Diversity

2025-12-05 · Germán Kruszewski, Pierre Erbacher, Jos Rozen, Marc Dymetman arxiv

Reinforcement Learning (RL) has become the de facto standard for tuning LLMs to solve tasks involving reasoning. However, growing evidence shows that models trained in such way often suffer from a significant loss in div…

Reinforcement Learning

Fundamental Lack of Information in Observed Disease and Hospitalization Data

2023-01-25 · Adam Mielke, Lasse Engbo Christiansen

We present a proof based on SEIR-models that shows it is impossible to identify the level of under reporting based on traditional observables of the disease dynamics alone. This means that the true attack rate must be de…

Mathematical Explanations

2023-12-31 · Joseph Y. Halpern

A definition of what counts as an explanation of mathematical statement, and when one explanation is better than another, is given. Since all mathematical facts must be true in all causal models, and hence known by an ag…

All