paper-with-me

Papers

Steerable Partial Differential Operators for Equivariant Neural Networks

2021-06-18 · ICLR 2022 4 · Erik Jenner, Maurice Weiler

Recent work in equivariant deep learning bears strong similarities to physics. Fields over a base space are fundamental entities in both subjects, as are equivariant maps between these fields. In deep learning, however, these maps are usually defined by convolutions with a kernel, whereas they are partial differential operators (PDOs) in physics. Developing the theory of equivariant PDOs in the context of deep learning could bring these subjects even closer together and lead to a stronger flow of ideas. In this work, we derive a $G$-steerability constraint that completely characterizes when a PDO between feature vector fields is equivariant, for arbitrary symmetry groups $G$. We then fully solve this constraint for several important groups. We use our solutions as equivariant drop-in replacements for convolutional layers and benchmark them in that role. Finally, we develop a framework for equivariant maps based on Schwartz distributions that unifies classical convolutions and differential operators and gives insight about the relation between the two.

📄 PDF Abstract BibTeX arXiv:2106.10163

Code (4)

ejnnr/steerable_pdo_experiments 공식 구현 pytorch
ejnnr/steerable_pdos 공식 구현 pytorch
QUVA-Lab/e2cnn pytorch
lewj85/e2cnn_experiments pytorch

Tasks

Deep Learning

Similar Papers 제목 키워드 기반

PDO-s3DCNNs: Partial Differential Operator Based Steerable 3D CNNs

2022-08-07 · Zhengyang Shen, Tao Hong, Qi She, Jinwen Ma 외

Steerable models can provide very general and flexible equivariance by formulating equivariance requirements in the language of representation theory and feature fields, which has been recognized to be effective for many…

Retrieval

Surrogate Modeling of 3D Rayleigh-Benard Convection with Equivariant Autoencoders

2025-05-19 · Fynn Fromme, Christine Allen-Blanchette, Hans Harder, Sebastian Peitz

The use of machine learning for modeling, understanding, and controlling large-scale physics systems is quickly gaining in popularity, with examples ranging from electromagnetism over nuclear fusion reactors and magneto-…

Differential invariants for SE(2)-equivariant networks

2022-06-27 · Mateus Sangalli, Samy Blusseau, Santiago Velasco-Forero, Jesús Angulo

Symmetry is present in many tasks in computer vision, where the same class of objects can appear transformed, e.g. rotated due to different camera orientations, or scaled due to perspective. The knowledge of such symmetr…

Steerable Neural ODEs on Homogeneous Spaces

2026-05-11 · Emma Andersdotter, Daniel Persson, Fredrik Ohlsson arxiv

We introduce steerable neural ordinary differential equations on homogeneous spaces $M=G/H$. These models constitute a novel geometric extension of manifold neural ordinary differential equations (NODEs) that transport a…

A Wigner-Eckart Theorem for Group Equivariant Convolution Kernels

2020-10-21 · ICLR 2021 1 · Leon Lang, Maurice Weiler

Group equivariant convolutional networks (GCNNs) endow classical convolutional networks with additional symmetry priors, which can lead to a considerably improved performance. Recent advances in the theoretical descripti…