On the Implicit Bias of Linear Equivariant Steerable Networks
We study the implicit bias of gradient flow on linear equivariant steerable networks in group-invariant binary classification. Our findings reveal that the parameterized predictor converges in direction to the unique group-invariant classifier with a maximum margin defined by the input group action. Under a unitary assumption on the input representation, we establish the equivalence between steerable networks and data augmentation. Furthermore, we demonstrate the improved margin and generalization bound of steerable networks over their non-invariant counterparts.
Code (0)
등록된 구현이 없습니다.
Tasks
Binary ClassificationData AugmentationSimilar Papers 제목 키워드 기반
Implicit Convolutional Kernels for Steerable CNNs
Steerable convolutional neural networks (CNNs) provide a general framework for building neural networks equivariant to translations and transformations of an origin-preserving group $G$, such as reflections and rotations…
Molecular Property PredictionPoint Cloud ClassificationProperty PredictionGeometric and Physical Quantities Improve E(3) Equivariant Message Passing
Including covariant information, such as position, force, velocity or spin is important in many tasks in computational physics and chemistry. We introduce Steerable E(3) Equivariant Graph Neural Networks (SEGNNs) that ge…
Graph Property Prediction3D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Data
We present a convolutional network that is equivariant to rigid body motions. The model uses scalar-, vector-, and tensor fields over 3D Euclidean space to represent data, and equivariant convolutions to map between such…
General ClassificationSteerable Equivariant Representation Learning
Pre-trained deep image representations are useful for post-training tasks such as classification through transfer learning, image retrieval, and object detection. Data augmentations are a crucial aspect of pre-training r…
Image Retrievalobject-detectionObject DetectionOut-of-Distribution Detection+3Clifford-Steerable Convolutional Neural Networks
We present Clifford-Steerable Convolutional Neural Networks (CS-CNNs), a novel class of $\mathrm{E}(p, q)$-equivariant CNNs. CS-CNNs process multivector fields on pseudo-Euclidean spaces $\mathbb{R}^{p,q}$. They cover, f…