paper-with-me

Papers

Interpretable Graph Capsule Networks for Object Recognition

2020-12-03 · Jindong Gu, Volker Tresp

Capsule Networks, as alternatives to Convolutional Neural Networks, have been proposed to recognize objects from images. The current literature demonstrates many advantages of CapsNets over CNNs. However, how to create explanations for individual classifications of CapsNets has not been well explored. The widely used saliency methods are mainly proposed for explaining CNN-based classifications; they create saliency map explanations by combining activation values and the corresponding gradients, e.g., Grad-CAM. These saliency methods require a specific architecture of the underlying classifiers and cannot be trivially applied to CapsNets due to the iterative routing mechanism therein. To overcome the lack of interpretability, we can either propose new post-hoc interpretation methods for CapsNets or modifying the model to have build-in explanations. In this work, we explore the latter. Specifically, we propose interpretable Graph Capsule Networks (GraCapsNets), where we replace the routing part with a multi-head attention-based Graph Pooling approach. In the proposed model, individual classification explanations can be created effectively and efficiently. Our model also demonstrates some unexpected benefits, even though it replaces the fundamental part of CapsNets. Our GraCapsNets achieve better classification performance with fewer parameters and better adversarial robustness, when compared to CapsNets. Besides, GraCapsNets also keep other advantages of CapsNets, namely, disentangled representations and affine transformation robustness.

📄 PDF Abstract BibTeX arXiv:2012.01674

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial RobustnessObjectObject Recognition

Similar Papers 제목 키워드 기반

Graphics Capsule: Learning Hierarchical 3D Face Representations from 2D Images

2023-03-20 · CVPR 2023 1 · Chang Yu, Xiangyu Zhu, Xiaomei Zhang, Zhaoxiang Zhang 외

The function of constructing the hierarchy of objects is important to the visual process of the human brain. Previous studies have successfully adopted capsule networks to decompose the digits and faces into parts in an …

Face Recognition

Graph Capsule Aggregation for Unaligned Multimodal Sequences

2021-08-17 · Jianfeng Wu, Sijie Mai, Haifeng Hu

Humans express their opinions and emotions through multiple modalities which mainly consist of textual, acoustic and visual modalities. Prior works on multimodal sentiment analysis mostly apply Recurrent Neural Network (…

Multimodal Sentiment AnalysisSentiment Analysis

Geometric Capsule Autoencoders for 3D Point Clouds

2019-12-06 · Nitish Srivastava, Hanlin Goh, Ruslan Salakhutdinov

We propose a method to learn object representations from 3D point clouds using bundles of geometrically interpretable hidden units, which we call geometric capsules. Each geometric capsule represents a visual entity, suc…

ObjectRetrieval

Encoding Visual Attributes in Capsules for Explainable Medical Diagnoses

2019-09-12 · Rodney LaLonde, Drew Torigian, Ulas Bagci

Convolutional neural network based systems have largely failed to be adopted in many high-risk application areas, including healthcare, military, security, transportation, finance, and legal, due to their highly uninterp…

AttributeLung Cancer DiagnosisMulti-Task Learning

Why Capsule Neural Networks Do Not Scale: Challenging the Dynamic Parse-Tree Assumption

2023-01-04 · Matthias Mitterreiter, Marcel Koch, Joachim Giesen, Sören Laue

Capsule neural networks replace simple, scalar-valued neurons with vector-valued capsules. They are motivated by the pattern recognition system in the human brain, where complex objects are decomposed into a hierarchy of…