Equivariant Wavelets: Fast Rotation and Translation Invariant Wavelet Scattering Transforms
Wavelet scattering networks, which are convolutional neural networks (CNNs) with fixed filters and weights, are promising tools for image analysis. Imposing symmetry on image statistics can improve human interpretability, aid in generalization, and provide dimension reduction. In this work, we introduce a fast-to-compute, translationally invariant and rotationally equivariant wavelet scattering network (EqWS) and filter bank of wavelets (triglets). We demonstrate the interpretability and quantify the invariance/equivariance of the coefficients, briefly commenting on difficulties with implementing scale equivariance. On MNIST, we show that training on a rotationally invariant reduction of the coefficients maintains rotational invariance when generalized to test data and visualize residual symmetry breaking terms. Rotation equivariance is leveraged to estimate the rotation angle of digits and reconstruct the full rotation dependence of each coefficient from a single angle. We benchmark EqWS with linear classifiers on EMNIST and CIFAR-10/100, introducing a new second-order, cross-color channel coupling for the color images. We conclude by comparing the performance of an isotropic reduction of the scattering coefficients and RWST, a previous coefficient reduction, on an isotropic classification of magnetohydrodynamic simulations with astrophysical relevance.
Code (1)
Tasks
Dimensionality ReductionTranslationSimilar Papers 제목 키워드 기반
Rigid-Motion Scattering for Texture Classification
A rigid-motion scattering computes adaptive invariants along translations and rotations, with a deep convolutional network. Convolutions are calculated on the rigid-motion group, with wavelets defined on the translation …
ClassificationGeneral ClassificationTexture ClassificationTranslationLearning Invariant Representations for Equivariant Neural Networks Using Orthogonal Moments
The convolutional layers of standard convolutional neural networks (CNNs) are equivariant to translation. However, the convolution and fully-connected layers are not equivariant or invariant to other affine geometric tra…
Rotated MNISTTranslationSteerable Wavelet Scattering for 3D Atomic Systems with Application to Li-Si Energy Prediction
A general machine learning architecture is introduced that uses wavelet scattering coefficients of an inputted three dimensional signal as features. Solid harmonic wavelet scattering transforms of three dimensional signa…
BIG-bench Machine LearningFormation EnergyregressionUnsupervised Object Representation Learning using Translation and Rotation Group Equivariant VAE
In many imaging modalities, objects of interest can occur in a variety of locations and poses (i.e. are subject to translations and rotations in 2d or 3d), but the location and pose of an object does not change its seman…
Learning Semantic RepresentationsObjectObject DetectionPose Prediction+2Rotation-Equivariant Keypoint Detection
We show how to train a rotation-equivariant representation to extract local keypoints for image matching. Existing learning-based methods focused on extracting translation-equivariant keypoints using conventional convolu…
Keypoint DetectionTranslation