Permutation Equivariant Neural Networks for Symmetric Tensors
Incorporating permutation equivariance into neural networks has proven to be useful in ensuring that models respect symmetries that exist in data. Symmetric tensors, which naturally appear in statistics, machine learning, and graph theory, are essential for many applications in physics, chemistry, and materials science, amongst others. However, existing research on permutation equivariant models has not explored symmetric tensors as inputs, and most prior work on learning from these tensors has focused on equivariance to Euclidean groups. In this paper, we present two different characterisations of all linear permutation equivariant functions between symmetric power spaces of $\mathbb{R}^n$. We show on two tasks that these functions are highly data efficient compared to standard MLPs and have potential to generalise well to symmetric tensors of different sizes.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Fast computation of permutation equivariant layers with the partition algebra
Linear neural network layers that are either equivariant or invariant to permutations of their inputs form core building blocks of modern deep learning architectures. Examples include the layers of DeepSets, as well as l…
Unifying O(3) Equivariant Neural Networks Design with Tensor-Network Formalism
Many learning tasks, including learning potential energy surfaces from ab initio calculations, involve global spatial symmetries and permutational symmetry between atoms or general particles. Equivariant graph neural net…
Tensor NetworksConstructing 3D Rotational Invariance and Equivariance with Symmetric Tensor Networks
Symmetry-aware architectures are central to geometric deep learning. We present a systematic approach for constructing continuous rotationally invariant and equivariant functions using symmetric tensor networks. The prop…
P-tensors: a General Formalism for Constructing Higher Order Message Passing Networks
Several recent papers have recently shown that higher order graph neural networks can achieve better accuracy than their standard message passing counterparts, especially on highly structured graphs such as molecules. Th…
RotEqNet: Rotation-Equivariant Network for Fluid Systems with Symmetric High-Order Tensors
In the recent application of scientific modeling, machine learning models are largely applied to facilitate computational simulations of fluid systems. Rotation symmetry is a general property for most symmetric fluid sys…
BIG-bench Machine LearningData Augmentation