The What-If Tool: Interactive Probing of Machine Learning Models
A key challenge in developing and deploying Machine Learning (ML) systems is understanding their performance across a wide range of inputs. To address this challenge, we created the What-If Tool, an open-source application that allows practitioners to probe, visualize, and analyze ML systems, with minimal coding. The What-If Tool lets practitioners test performance in hypothetical situations, analyze the importance of different data features, and visualize model behavior across multiple models and subsets of input data. It also lets practitioners measure systems according to multiple ML fairness metrics. We describe the design of the tool, and report on real-life usage at different organizations.
Code (1)
Tasks
BIG-bench Machine LearningFairnessSimilar Papers 제목 키워드 기반
Gaussian Process Probes (GPP) for Uncertainty-Aware Probing
Understanding which concepts models can and cannot represent has been fundamental to many tasks: from effective and responsible use of models to detecting out of distribution data. We introduce Gaussian process probes (G…
What do you learn from context? Probing for sentence structure in contextualized word representations
The jiant toolkit for general-purpose text understanding models
Language ModellingSentenceInteractiveGNNExplainer: A Visual Analytics Framework for Multi-Faceted Understanding and Probing of Graph Neural Network Predictions
Graph Neural Networks (GNNs) excel in graph-based learning tasks, but their complex, non-linear operations often render them as opaque "black boxes". This opacity hinders user trust, complicates debugging, bias detection…
Graph Neural NetworkNode ClassificationBias DetectionPROBE-Web: An Interactive System for Probing Evaluation Landscapes of Knowledge Graph Completion Models
Knowledge graph completion (KGC) models are commonly evaluated using rank-based metrics such as MRR and Hits@K, despite different users often requiring different evaluation perspectives. In this demo, we present PROBE-We…
Knowledge Graph CompletionAmnesic Probing: Behavioral Explanation with Amnesic Counterfactuals
A growing body of work makes use of probing to investigate the working of neural models, often considered black boxes. Recently, an ongoing debate emerged surrounding the limitations of the probing paradigm. In this work…