Interpretable to Whom? A Role-based Model for Analyzing Interpretable Machine Learning Systems
Several researchers have argued that a machine learning system's interpretability should be defined in relation to a specific agent or task: we should not ask if the system is interpretable, but to whom is it interpretable. We describe a model intended to help answer this question, by identifying different roles that agents can fulfill in relation to the machine learning system. We illustrate the use of our model in a variety of scenarios, exploring how an agent's role influences its goals, and the implications for defining interpretability. Finally, we make suggestions for how our model could be useful to interpretability researchers, system developers, and regulatory bodies auditing machine learning systems.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningInterpretable Machine LearningRelationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Interpretable Semantic Role Relation Table for Supporting Facts Recognition of Reading Comprehension
The current Machine Reading Comprehension (MRC) model has poor interpretability. Interpretable semantic features can enhancethe interpretability of the model. Semantic role labeling (SRL) captures predicate-argument re…
Machine Reading ComprehensionReading ComprehensionRelationSemantic Role Labeling+1Scientific Inference With Interpretable Machine Learning: Analyzing Models to Learn About Real-World Phenomena
To learn about real world phenomena, scientists have traditionally used models with clearly interpretable elements. However, modern machine learning (ML) models, while powerful predictors, lack this direct elementwise in…
BIG-bench Machine LearningInterpretable Machine LearningLearning TheoryInterpretable Assessment of Fairness During Model Evaluation
For companies developing products or algorithms, it is important to understand the potential effects not only globally, but also on sub-populations of users. In particular, it is important to detect if there are certain …
ClusteringFairnessmodelInterpretable Role-Based Clustering in Multi-Layer Financial Networks
Understanding the functional roles of financial institutions within interconnected markets is critical for effective supervision, systemic risk assessment, and resolution planning. We propose an interpretable role-based …
Interpretable collaborative data analysis on distributed data
This paper proposes an interpretable non-model sharing collaborative data analysis method as one of the federated learning systems, which is an emerging technology to analyze distributed data. Analyzing distributed data …
Federated Learning