paper-with-me

홈 › Papers

Iterative collaborative routing among equivariant capsules for transformation-robust capsule networks

2022-10-20 · Sai Raam Venkataraman, S. Balasubramanian, R. Raghunatha Sarma

Transformation-robustness is an important feature for machine learning models that perform image classification. Many methods aim to bestow this property to models by the use of data augmentation strategies, while more formal guarantees are obtained via the use of equivariant models. We recognise that compositional, or part-whole structure is also an important aspect of images that has to be considered for building transformation-robust models. Thus, we propose a capsule network model that is, at once, equivariant and compositionality-aware. Equivariance of our capsule network model comes from the use of equivariant convolutions in a carefully-chosen novel architecture. The awareness of compositionality comes from the use of our proposed novel, iterative, graph-based routing algorithm, termed Iterative collaborative routing (ICR). ICR, the core of our contribution, weights the predictions made for capsules based on an iteratively averaged score of the degree-centralities of its nearest neighbours. Experiments on transformed image classification on FashionMNIST, CIFAR-10, and CIFAR-100 show that our model that uses ICR outperforms convolutional and capsule baselines to achieve state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2210.11095

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentationimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Capsule Network A capsule is an activation vector that basically executes on its inputs some complex internal computations. Length of these activation vectors signifies the probability of…

Similar Papers 제목 키워드 기반

Using dynamic routing to extract intermediate features for developing scalable capsule networks

2019-07-13 · Bodhisatwa Mandal, Swarnendu Ghosh, Ritesh Sarkhel, Nibaran Das 외

Capsule networks have gained a lot of popularity in short time due to its unique approach to model equivariant class specific properties as capsules from images. However the dynamic routing algorithm comes with a steep c…

Grouping Capsules Based Different Types

2019-11-12 · Qiang Ren

Capsule network was introduced as a new architecture of neural networks, it encoding features as capsules to overcome the lacking of equivariant in the convolutional neural networks. It uses dynamic routing algorithm to …

Attention routing between capsules

2019-07-03 · Jaewoong Choi, Hyun Seo, Suii Im, Myungjoo Kang

In this paper, we propose a new capsule network architecture called Attention Routing CapsuleNet (AR CapsNet). We replace the dynamic routing and squash activation function of the capsule network with dynamic routing (Ca…

Decoder

Quaternion Equivariant Capsule Networks for 3D Point Clouds

2019-12-27 · ECCV 2020 8 · Yongheng Zhao, Tolga Birdal, Jan Eric Lenssen, Emanuele Menegatti 외

We present a 3D capsule module for processing point clouds that is equivariant to 3D rotations and translations, as well as invariant to permutations of the input points. The operator receives a sparse set of local refer…

Pose Estimation

Building Deep Equivariant Capsule Networks

2020-05-01 · ICLR 2020 1 · Sai Raam Venkataraman, S. Balasubramanian, R. Raghunatha Sarma

Capsule networks are constrained by the parameter-expensive nature of their layers, and the general lack of provable equivariance guarantees. We present a variation of capsule networks that aims to remedy this. We identi…