paper-with-me

홈 › Papers

Deformable Capsules for Object Detection

2021-04-11 · Rodney LaLonde, Naji Khosravan, Ulas Bagci

Capsule networks promise significant benefits over convolutional networks by storing stronger internal representations, and routing information based on the agreement between intermediate representations' projections. Despite this, their success has been limited to small-scale classification datasets due to their computationally expensive nature. Though memory efficient, convolutional capsules impose geometric constraints that fundamentally limit the ability of capsules to model the pose/deformation of objects. Further, they do not address the bigger memory concern of class-capsules scaling up to bigger tasks such as detection or large-scale classification. In this study, we introduce a new family of capsule networks, deformable capsules (\textit{DeformCaps}), to address a very important problem in computer vision: object detection. We propose two new algorithms associated with our \textit{DeformCaps}: a novel capsule structure (\textit{SplitCaps}), and a novel dynamic routing algorithm (\textit{SE-Routing}), which balance computational efficiency with the need for modeling a large number of objects and classes, which have never been achieved with capsule networks before. We demonstrate that the proposed methods efficiently scale up to create the first-ever capsule network for object detection in the literature. Our proposed architecture is a one-stage detection framework and it obtains results on MS COCO which are on par with state-of-the-art one-stage CNN-based methods, while producing fewer false positive detection, generalizing to unusual poses/viewpoints of objects.

📄 PDF Abstract BibTeX arXiv:2104.05031

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Capsule Network A capsule is an activation vector that basically executes on its inputs some complex internal computations. Length of these activation vectors signifies the probability of…

Similar Papers 제목 키워드 기반

Employing Deep Part-Object Relationships for Salient Object Detection

2019-10-01 · ICCV 2019 10 · Yi Liu, Qiang Zhang, Dingwen Zhang, Jungong Han

Despite Convolutional Neural Networks (CNNs) based methods have been successful in detecting salient objects, their underlying mechanism that decides the salient intensity of each image part separately cannot avoid incon…

Objectobject-detectionObject DetectionRGB Salient Object Detection+1

Mamba Capsule Routing Towards Part-Whole Relational Camouflaged Object Detection

2024-10-05 · Dingwen Zhang, Liangbo Cheng, Yi Liu, Xinggang Wang 외

The part-whole relational property endowed by Capsule Networks (CapsNets) has been known successful for camouflaged object detection due to its segmentation integrity. However, the previous Expectation Maximization (EM) …

Mambaobject-detectionObject Detection

DFAM-DETR: Deformable feature based attention mechanism DETR on slender object detection

2022-04-22 · Wen Feng, Wang Mei, Hu Xiaojie

Object detection is one of the most significant aspects of computer vision, and it has achieved substantial results in a variety of domains. It is worth noting that there are few studies focusing on slender object detect…

Objectobject-detectionObject Detection

Hybrid Gromov-Wasserstein Embedding for Capsule Learning

2022-09-01 · Pourya Shamsolmoali, Masoumeh Zareapoor, Swagatam Das, Eric Granger 외

Capsule networks (CapsNets) aim to parse images into a hierarchy of objects, parts, and their relations using a two-step process involving part-whole transformation and hierarchical component routing. However, this hiera…

object-detectionObject Detection

A Neural-Symbolic Architecture for Inverse Graphics Improved by Lifelong Meta-Learning

2019-05-22 · Michael Kissner, Helmut Mayer

We follow the idea of formulating vision as inverse graphics and propose a new type of element for this task, a neural-symbolic capsule. It is capable of de-rendering a scene into semantic information feed-forward, as we…

Few-Shot LearningMeta-Learning