paper-with-me

Papers

Subspace Capsule Network

2020-02-07 · Marzieh Edraki, Nazanin Rahnavard, Mubarak Shah

Convolutional neural networks (CNNs) have become a key asset to most of fields in AI. Despite their successful performance, CNNs suffer from a major drawback. They fail to capture the hierarchy of spatial relation among different parts of an entity. As a remedy to this problem, the idea of capsules was proposed by Hinton. In this paper, we propose the SubSpace Capsule Network (SCN) that exploits the idea of capsule networks to model possible variations in the appearance or implicitly defined properties of an entity through a group of capsule subspaces instead of simply grouping neurons to create capsules. A capsule is created by projecting an input feature vector from a lower layer onto the capsule subspace using a learnable transformation. This transformation finds the degree of alignment of the input with the properties modeled by the capsule subspace. We show that SCN is a general capsule network that can successfully be applied to both discriminative and generative models without incurring computational overhead compared to CNN during test time. Effectiveness of SCN is evaluated through a comprehensive set of experiments on supervised image classification, semi-supervised image classification and high-resolution image generation tasks using the generative adversarial network (GAN) framework. SCN significantly improves the performance of the baseline models in all 3 tasks.

📄 PDF Abstract BibTeX arXiv:2002.02924

Code (1)

MarziEd/SubSpace-Capsule-Network 공식 구현 tf

Tasks

General ClassificationGenerative Adversarial Networkimage-classificationImage ClassificationImage GenerationSemi-Supervised Image Classification

Methods 이 논문이 사용한 방법론

Test 설명 없음
Capsule Network A capsule is an activation vector that basically executes on its inputs some complex internal computations. Length of these activation vectors signifies the probability of…

Similar Papers 제목 키워드 기반

CapProNet: Deep Feature Learning via Orthogonal Projections onto Capsule Subspaces

2018-05-19 · NeurIPS 2018 12 · Liheng Zhang, Marzieh Edraki, Guo-Jun Qi

In this paper, we formalize the idea behind capsule nets of using a capsule vector rather than a neuron activation to predict the label of samples. To this end, we propose to learn a group of capsule subspaces onto which…

Lightweight yet Fine-grained: A Graph Capsule Convolutional Network with Subspace Alignment for Shared-account Sequential Recommendation

2024-12-18 · Jinyu Zhang, Zhongying Zhao, Chao Li, Yanwei Yu

Shared-account Sequential Recommendation (SSR) aims to provide personalized recommendations for accounts shared by multiple users with varying sequential preferences. Previous studies on SSR struggle to capture the fine-…

Sequential Recommendation

Capsule-Transformer for Neural Machine Translation

2020-04-30 · Sufeng Duan, Juncheng Cao, Hai Zhao

Transformer hugely benefits from its key design of the multi-head self-attention network (SAN), which extracts information from various perspectives through transforming the given input into different subspaces. However,…

Machine TranslationTranslation

Quantum Capsule Networks

2022-01-05 · Zidu Liu, Pei-Xin Shen, Weikang Li, L. -M. Duan 외

Capsule networks, which incorporate the paradigms of connectionism and symbolism, have brought fresh insights into artificial intelligence. The capsule, as the building block of capsule networks, is a group of neurons re…

Quantum Machine Learning

Improving Multi-Head Attention with Capsule Networks

2019-08-31 · Shuhao Gu, Yang Feng

Multi-head attention advances neural machine translation by working out multiple versions of attention in different subspaces, but the neglect of semantic overlapping between subspaces increases the difficulty of transla…

ClusteringMachine TranslationTranslation