paper-with-me

Papers

A Program to Build E(N)-Equivariant Steerable CNNs

2021-09-29 · ICLR 2022 4 · Gabriele Cesa, Leon Lang, Maurice Weiler

Equivariance is becoming an increasingly popular design choice to build data efficient neural networks by exploiting prior knowledge about the symmetries of the problem at hand. Euclidean steerable CNNs are one of the most common classes of equivariant networks. While the constraints these architectures need to satisfy are understood, no practical method to parametrize them generally has been described so far, with most existing approaches tailored to specific groups or classes of groups. In this work, we generalize the Wigner-Eckart theorem proposed in (Lang et al.), which characterizes general $G$-steerable kernel spaces for compact groups $G$ over their homogeneous spaces, to arbitrary $G$-spaces. This enables us to directly parameterize filters in terms of a band-limited basis on the base space, but also to easily implement steerable CNNs equivariant to a large number of groups. To demonstrate its generality, we instantiate our method on a large variety of isometry groups acting on the Euclidean space $\mathbb{R}^3$. Our general framework allows us to build $E(3)$ and $SE(3)$-steerable CNNs like previous works, but also CNNs with arbitrary $G\leq O(3)$-steerable kernels. For example, we build 3D CNNs equivariant to the symmetries of platonic solids or choose $G=SO(2)$ when working with 3D data having only azimuthal symmetries. We compare these models on 3D shapes and molecular datasets, observing improved performance by matching the model's symmetries to the ones of the data.

📄 PDF Abstract BibTeX

Code (1)

quva-lab/escnn 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Implicit Convolutional Kernels for Steerable CNNs

2022-12-12 · NeurIPS 2023 11 · Maksim Zhdanov, Nico Hoffmann, Gabriele Cesa

Steerable convolutional neural networks (CNNs) provide a general framework for building neural networks equivariant to translations and transformations of an origin-preserving group $G$, such as reflections and rotations…

Molecular Property PredictionPoint Cloud ClassificationProperty Prediction

General E(2)-Equivariant Steerable CNNs

2019-12-01 · NeurIPS 2019 12 · Maurice Weiler, Gabriele Cesa

The big empirical success of group equivariant networks has led in recent years to the sprouting of a great variety of equivariant network architectures. A particular focus has thereby been on rotation and reflection equ…

Rotated MNIST

General $E(2)$-Equivariant Steerable CNNs

2019-11-19 · Maurice Weiler, Gabriele Cesa

The big empirical success of group equivariant networks has led in recent years to the sprouting of a great variety of equivariant network architectures. A particular focus has thereby been on rotation and reflection equ…

Image Classification

3D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Data

2018-07-06 · NeurIPS 2018 12 · Maurice Weiler, Mario Geiger, Max Welling, Wouter Boomsma 외

We present a convolutional network that is equivariant to rigid body motions. The model uses scalar-, vector-, and tensor fields over 3D Euclidean space to represent data, and equivariant convolutions to map between such…

General Classification

Nonlinearities in Steerable SO(2)-Equivariant CNNs

2021-09-14 · Daniel Franzen, Michael Wand

Invariance under symmetry is an important problem in machine learning. Our paper looks specifically at equivariant neural networks where transformations of inputs yield homomorphic transformations of outputs. Here, steer…