On Learning and Learned Data Representation by Capsule Networks
In this work, we investigate the following: 1) how the routing affects the CapsNet model fitting; 2) how the representation using capsules helps discover global structures in data distribution, and; 3) how the learned data representation adapts and generalizes to new tasks. Our investigation yielded the results some of which have been mentioned in the original paper of CapsNet, they are: 1) the routing operation determines the certainty with which a layer of capsules pass information to the layer above and the appropriate level of certainty is related to the model fitness; 2) in a designed experiment using data with a known 2D structure, capsule representations enable a more meaningful 2D manifold embedding than neurons do in a standard convolutional neural network (CNN), and; 3) compared with neurons of the standard CNN, capsules of successive layers are less coupled and more adaptive to new data distribution.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Kernelized Capsule Networks
Capsule Networks attempt to represent patterns in images in a way that preserves hierarchical spatial relationships. Additionally, research has demonstrated that these techniques may be robust against adversarial perturb…
Gaussian ProcessesCapsule Attention for Multimodal EEG-EOG Representation Learning with Application to Driver Vigilance Estimation
Driver vigilance estimation is an important task for transportation safety. Wearable and portable brain-computer interface devices provide a powerful means for real-time monitoring of the vigilance level of drivers to he…
Brain Computer InterfaceEEGElectroencephalogram (EEG)Representation LearningGeometric Capsule Autoencoders for 3D Point Clouds
We propose a method to learn object representations from 3D point clouds using bundles of geometrically interpretable hidden units, which we call geometric capsules. Each geometric capsule represents a visual entity, suc…
ObjectRetrievalIso-CapsNet: Isomorphic Capsule Network for Brain Graph Representation Learning
Brain graph representation learning serves as the fundamental technique for brain diseases diagnosis. Great efforts from both the academic and industrial communities have been devoted to brain graph representation learni…
Graph Representation LearningRepresentation LearningVariational Capsule Encoder
We propose a novel capsule network based variational encoder architecture, called Bayesian capsules (B-Caps), to modulate the mean and standard deviation of the sampling distribution in the latent space. We hypothesized …
Image ReconstructionRepresentation Learning