Pantypes: Diverse Representatives for Self-Explainable Models
Prototypical self-explainable classifiers have emerged to meet the growing demand for interpretable AI systems. These classifiers are designed to incorporate high transparency in their decisions by basing inference on similarity with learned prototypical objects. While these models are designed with diversity in mind, the learned prototypes often do not sufficiently represent all aspects of the input distribution, particularly those in low density regions. Such lack of sufficient data representation, known as representation bias, has been associated with various detrimental properties related to machine learning diversity and fairness. In light of this, we introduce pantypes, a new family of prototypical objects designed to capture the full diversity of the input distribution through a sparse set of objects. We show that pantypes can empower prototypical self-explainable models by occupying divergent regions of the latent space and thus fostering high diversity, interpretability and fairness.
Code (1)
Tasks
DiversityExplainable ModelsFairnessMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards Interpretable and Efficient Attention: Compressing All by Contracting a Few
Attention mechanisms have achieved significant empirical success in multiple fields, but their underlying optimization objectives remain unclear yet. Moreover, the quadratic complexity of self-attention has become increa…
Online Summarization via Submodular and Convex Optimization
We consider the problem of subset selection in the online setting, where data arrive incrementally. Instead of storing and running subset selection on the entire dataset, we propose an incremental subset selection framew…
Video SummarizationLanguage Agents as Digital Representatives in Collective Decision-Making
Consider the process of collective decision-making, in which a group of individuals interactively select a preferred outcome from among a universe of alternatives. In this context, "representation" is the activity of mak…
Decision MakingProtoVAE: A Trustworthy Self-Explainable Prototypical Variational Model
The need for interpretable models has fostered the development of self-explainable classifiers. Prior approaches are either based on multi-stage optimization schemes, impacting the predictive performance of the model, or…
DiversitymodeleX-ViT: A Novel eXplainable Vision Transformer for Weakly Supervised Semantic Segmentation
Recently vision transformer models have become prominent models for a range of vision tasks. These models, however, are usually opaque with weak feature interpretability. Moreover, there is no method currently built for …
AttributeSemantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic Segmentation