paper-with-me

홈 › Papers

VolterraNet: A higher order convolutional network with group equivariance for homogeneous manifolds

2021-06-05 · Monami Banerjee, Rudrasis Chakraborty, Jose Bouza, Baba C. Vemuri

Convolutional neural networks have been highly successful in image-based learning tasks due to their translation equivariance property. Recent work has generalized the traditional convolutional layer of a convolutional neural network to non-Euclidean spaces and shown group equivariance of the generalized convolution operation. In this paper, we present a novel higher order Volterra convolutional neural network (VolterraNet) for data defined as samples of functions on Riemannian homogeneous spaces. Analagous to the result for traditional convolutions, we prove that the Volterra functional convolutions are equivariant to the action of the isometry group admitted by the Riemannian homogeneous spaces, and under some restrictions, any non-linear equivariant function can be expressed as our homogeneous space Volterra convolution, generalizing the non-linear shift equivariant characterization of Volterra expansions in Euclidean space. We also prove that second order functional convolution operations can be represented as cascaded convolutions which leads to an efficient implementation. Beyond this, we also propose a dilated VolterraNet model. These advances lead to large parameter reductions relative to baseline non-Euclidean CNNs. To demonstrate the efficacy of the VolterraNet performance, we present several real data experiments involving classification tasks on spherical-MNIST, atomic energy, Shrec17 data sets, and group testing on diffusion MRI data. Performance comparisons to the state-of-the-art are also presented.

📄 PDF Abstract BibTeX arXiv:2106.15301

Code (1)

cvgmi/volterra-net 공식 구현 pytorch

Tasks

Diffusion MRITranslation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Data

2020-02-25 · ICML 2020 1 · Marc Finzi, Samuel Stanton, Pavel Izmailov, Andrew Gordon Wilson

The translation equivariance of convolutional layers enables convolutional neural networks to generalize well on image problems. While translation equivariance provides a powerful inductive bias for images, we often addi…

Inductive BiasTranslation

Rotational 3D Texture Classification Using Group Equivariant CNNs

2018-10-16 · Vincent Andrearczyk, Adrien Depeursinge

Convolutional Neural Networks (CNNs) traditionally encode translation equivariance via the convolution operation. Generalization to other transformations has recently received attraction to encode the knowledge of the da…

ClassificationDiversityGeneral ClassificationTexture Classification+1

Higher Order Gauge Equivariant CNNs on Riemannian Manifolds and Applications

2023-05-26 · Gianfranco Cortes, Yue Yu, Robin Chen, Melissa Armstrong 외

With the advent of group equivariant convolutions in deep networks literature, spherical CNNs with $\mathsf{SO}(3)$-equivariant layers have been developed to cope with data that are samples of signals on the sphere $S^2$…

Group Equivariant Conditional Neural Processes

2021-02-17 · ICLR 2021 1 · Makoto Kawano, Wataru Kumagai, Akiyoshi Sannai, Yusuke Iwasawa 외

We present the group equivariant conditional neural process (EquivCNP), a meta-learning method with permutation invariance in a data set as in conventional conditional neural processes (CNPs), and it also has transformat…

Meta-LearningTranslationZero-shot Generalization

Learning Color Equivariant Representations

2024-06-13 · Yulong Yang, Felix O'Mahony, Christine Allen-Blanchette

In this paper, we introduce group convolutional neural networks (GCNNs) equivariant to color variation. GCNNs have been designed for a variety of geometric transformations from 2D and 3D rotation groups, to semi-groups s…