$β$-CapsNet: Learning Disentangled Representation for CapsNet by Information Bottleneck
We present a framework for learning disentangled representation of CapsNet by information bottleneck constraint that distills information into a compact form and motivates to learn an interpretable factorized capsule. In our $\beta$-CapsNet framework, hyperparameter $\beta$ is utilized to trade-off disentanglement and other tasks, variational inference is utilized to convert the information bottleneck term into a KL divergence that is approximated as a constraint on the mean of the capsule. For supervised learning, class independent mask vector is used for understanding the types of variations synthetically irrespective of the image class, we carry out extensive quantitative and qualitative experiments by tuning the parameter $\beta$ to figure out the relationship between disentanglement, reconstruction and classfication performance. Furthermore, the unsupervised $\beta$-CapsNet and the corresponding dynamic routing algorithm is proposed for learning disentangled capsule in an unsupervised manner, extensive empirical evaluations suggest that our $\beta$-CapsNet achieves state-of-the-art disentanglement performance compared to CapsNet and various baselines on several complex datasets both in supervision and unsupervised scenes.
Code (0)
등록된 구현이 없습니다.
Tasks
DisentanglementVariational InferenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
IBCapsNet: Information Bottleneck Capsule Network for Noise-Robust Representation Learning
Capsule networks (CapsNets) are superior at modeling hierarchical spatial relationships but suffer from two critical limitations: high computational cost due to iterative dynamic routing and poor robustness under input c…
Representation LearningInterpretable Graph Capsule Networks for Object Recognition
Capsule Networks, as alternatives to Convolutional Neural Networks, have been proposed to recognize objects from images. The current literature demonstrates many advantages of CapsNets over CNNs. However, how to create e…
Adversarial RobustnessObjectObject RecognitionQuick-CapsNet (QCN): A fast alternative to Capsule Networks
The basic computational unit in Capsule Network (CapsNet) is a capsule (vs. neurons in Convolutional Neural Networks (CNNs)). A capsule is a set of neurons, which form a vector. CapsNet is used for supervised classificat…
FR-CapsNet: Enhancing Low-Resolution Image Classification via Frequency Routed Capsules
Very low-resolution (VLR) images present a significant challenge for deep classification networks due to their inherent lack of fine spatial detail. While capsule networks (CapsNets), which encode spatial and pose inform…
image-classificationImage ClassificationTowards the Characterization of Representations Learned via Capsule-based Network Architectures
Capsule Networks (CapsNets) have been re-introduced as a more compact and interpretable alternative to standard deep neural networks. While recent efforts have proved their compression capabilities, to date, their interp…