Explainable Machine Learning in Deployment
Explainable machine learning offers the potential to provide stakeholders with insights into model behavior by using various methods such as feature importance scores, counterfactual explanations, or influential training data. Yet there is little understanding of how organizations use these methods in practice. This study explores how organizations view and use explainability for stakeholder consumption. We find that, currently, the majority of deployments are not for end users affected by the model but rather for machine learning engineers, who use explainability to debug the model itself. There is thus a gap between explainability in practice and the goal of transparency, since explanations primarily serve internal stakeholders rather than external ones. Our study synthesizes the limitations of current explainability techniques that hamper their use for end users. To facilitate end user interaction, we develop a framework for establishing clear goals for explainability. We end by discussing concerns raised regarding explainability.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningcounterfactualFeature ImportanceSimilar Papers 제목 키워드 기반
On the Importance of Application-Grounded Experimental Design for Evaluating Explainable ML Methods
Most existing evaluations of explainable machine learning (ML) methods rely on simplifying assumptions or proxies that do not reflect real-world use cases; the handful of more robust evaluations on real-world settings ha…
Experimental DesignFraud DetectionWhen and How to Fool Explainable Models (and Humans) with Adversarial Examples
Reliable deployment of machine learning models such as neural networks continues to be challenging due to several limitations. Some of the main shortcomings are the lack of interpretability and the lack of robustness aga…
BIG-bench Machine LearningExplainable ModelsExplainable AI does not provide the explanations end-users are asking for
Explainable Artificial Intelligence (XAI) techniques are frequently required by users in many AI systems with the goal of understanding complex models, their associated predictions, and gaining trust. While suitable for …
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Extending Explainable Boosting Machines to Scientific Image Data
As the deployment of computer vision technology becomes increasingly common in science, the need for explanations of the system and its output has become a focus of great concern. Driven by the pressing need for interpre…
EMMM, Explain Me My Model! Explainable Machine Generated Text Detection in Dialogues
The rapid adoption of large language models (LLMs) in customer service introduces new risks, as malicious actors can exploit them to conduct large-scale user impersonation through machine-generated text (MGT). Current MG…
Text Detection