paper-with-me

홈 › Papers

This Probably Looks Exactly Like That: An Invertible Prototypical Network

2024-07-16 · Zachariah Carmichael, Timothy Redgrave, Daniel Gonzalez Cedre, Walter J. Scheirer

We combine concept-based neural networks with generative, flow-based classifiers into a novel, intrinsically explainable, exactly invertible approach to supervised learning. Prototypical neural networks, a type of concept-based neural network, represent an exciting way forward in realizing human-comprehensible machine learning without concept annotations, but a human-machine semantic gap continues to haunt current approaches. We find that reliance on indirect interpretation functions for prototypical explanations imposes a severe limit on prototypes' informative power. From this, we posit that invertibly learning prototypes as distributions over the latent space provides more robust, expressive, and interpretable modeling. We propose one such model, called ProtoFlow, by composing a normalizing flow with Gaussian mixture models. ProtoFlow (1) sets a new state-of-the-art in joint generative and predictive modeling and (2) achieves predictive performance comparable to existing prototypical neural networks while enabling richer interpretation.

📄 PDF Abstract BibTeX arXiv:2407.12200

Code (1)

craymichael/protoflow 공식 구현 pytorch

Similar Papers 제목 키워드 기반

This Looks Like Those: Illuminating Prototypical Concepts Using Multiple Visualizations

2023-09-21 · NeurIPS 2023 11

We present ProtoConcepts, a method for interpretable image classification combining deep learning and case-based reasoning using prototypical parts. Existing work in prototype-based image classification uses a "this look…

This Looks Like That, Because ... Explaining Prototypes for Interpretable Image Recognition

2020-11-05 · Meike Nauta, Annemarie Jutte, Jesper Provoost, Christin Seifert

Image recognition with prototypes is considered an interpretable alternative for black box deep learning models. Classification depends on the extent to which a test image "looks like" a prototype. However, perceptual si…

ClassificationGeneral Classification

Semi-Supervised Few-Shot Classification with Deep Invertible Hybrid Models

2021-05-22 · Yusuke Ohtsubo, Tetsu Matsukawa, Einoshin Suzuki

In this paper, we propose a deep invertible hybrid model which integrates discriminative and generative learning at a latent space level for semi-supervised few-shot classification. Various tasks for classifying new spec…

ClassificationFew-Shot Learning

Video Extrapolation with an Invertible Linear Embedding

2019-03-01 · Robert Pottorff, Jared Nielsen, David Wingate

We predict future video frames from complex dynamic scenes, using an invertible neural network as the encoder of a nonlinear dynamic system with latent linear state evolution. Our invertible linear embedding (ILE) demons…

Predict Future Video Frames

ProtoArgNet: Interpretable Image Classification with Super-Prototypes and Argumentation [Technical Report]

2023-11-26 · Hamed Ayoobi, Nico Potyka, Francesca Toni

We propose ProtoArgNet, a novel interpretable deep neural architecture for image classification in the spirit of prototypical-part-learning as found, e.g., in ProtoPNet. While earlier approaches associate every class wit…

image-classificationImage Classification