paper-with-me

Papers

On Learning and Learned Data Representation by Capsule Networks

2018-10-08 · Ancheng Lin, Jun Li, Zhenyuan Ma

In this work, we investigate the following: 1) how the routing affects the CapsNet model fitting; 2) how the representation using capsules helps discover global structures in data distribution, and; 3) how the learned data representation adapts and generalizes to new tasks. Our investigation yielded the results some of which have been mentioned in the original paper of CapsNet, they are: 1) the routing operation determines the certainty with which a layer of capsules pass information to the layer above and the appropriate level of certainty is related to the model fitness; 2) in a designed experiment using data with a known 2D structure, capsule representations enable a more meaningful 2D manifold embedding than neurons do in a standard convolutional neural network (CNN), and; 3) compared with neurons of the standard CNN, capsules of successive layers are less coupled and more adaptive to new data distribution.

📄 PDF Abstract BibTeX arXiv:1810.04041

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Kernelized Capsule Networks

2019-06-07 · Taylor Killian, Justin Goodwin, Olivia Brown, Sung-Hyun Son

Capsule Networks attempt to represent patterns in images in a way that preserves hierarchical spatial relationships. Additionally, research has demonstrated that these techniques may be robust against adversarial perturb…

Gaussian Processes

Capsule Attention for Multimodal EEG-EOG Representation Learning with Application to Driver Vigilance Estimation

2019-12-17 · Guangyi Zhang, Ali Etemad

Driver vigilance estimation is an important task for transportation safety. Wearable and portable brain-computer interface devices provide a powerful means for real-time monitoring of the vigilance level of drivers to he…

Brain Computer InterfaceEEGElectroencephalogram (EEG)Representation Learning

Geometric Capsule Autoencoders for 3D Point Clouds

2019-12-06 · Nitish Srivastava, Hanlin Goh, Ruslan Salakhutdinov

We propose a method to learn object representations from 3D point clouds using bundles of geometrically interpretable hidden units, which we call geometric capsules. Each geometric capsule represents a visual entity, suc…

ObjectRetrieval

Iso-CapsNet: Isomorphic Capsule Network for Brain Graph Representation Learning

2022-06-27 · Jiawei Zhang

Brain graph representation learning serves as the fundamental technique for brain diseases diagnosis. Great efforts from both the academic and industrial communities have been devoted to brain graph representation learni…

Graph Representation LearningRepresentation Learning

Variational Capsule Encoder

2020-10-18 · Harish RaviPrakash, Syed Muhammad Anwar, Ulas Bagci

We propose a novel capsule network based variational encoder architecture, called Bayesian capsules (B-Caps), to modulate the mean and standard deviation of the sampling distribution in the latent space. We hypothesized …

Image ReconstructionRepresentation Learning