XAudit : A Theoretical Look at Auditing with Explanations
Responsible use of machine learning requires models to be audited for undesirable properties. While a body of work has proposed using explanations for auditing, how to do so and why has remained relatively ill-understood. This work formalizes the role of explanations in auditing and investigates if and how model explanations can help audits. Specifically, we propose explanation-based algorithms for auditing linear classifiers and decision trees for feature sensitivity. Our results illustrate that Counterfactual explanations are extremely helpful for auditing. While Anchors and decision paths may not be as beneficial in the worst-case, in the average-case they do aid a lot.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningcounterfactualSensitivitySimilar Papers 제목 키워드 기반
Auditing Local Explanations is Hard
In sensitive contexts, providers of machine learning algorithms are increasingly required to give explanations for their algorithms' decisions. However, explanation receivers might not trust the provider, who potentially…
Do not explain without context: addressing the blind spot of model explanations
The increasing number of regulations and expectations of predictive machine learning models, such as so called right to explanation, has led to a large number of methods promising greater interpretability. High demand ha…
BIG-bench Machine LearningExplainable Artificial Intelligence (XAI)Beyond Verification: Abductive Explanations for Post-AI Assessment of Privacy Leakage
Privacy leakage in AI-based decision processes poses significant risks, particularly when sensitive information can be inferred. We propose a formal framework to audit privacy leakage using abductive explanations, which …
Revisiting Data Auditing in Large Vision-Language Models
With the surge of large language models (LLMs), Large Vision-Language Models (VLMs)--which integrate vision encoders with LLMs for accurate visual grounding--have shown great potential in tasks like generalist agents and…
Visual GroundingRESHAPE: Explaining Accounting Anomalies in Financial Statement Audits by enhancing SHapley Additive exPlanations
Detecting accounting anomalies is a recurrent challenge in financial statement audits. Recently, novel methods derived from Deep-Learning (DL) have been proposed to audit the large volumes of a statement's underlying acc…
AttributeExplainable Artificial Intelligence (XAI)