Learning Steerable Filters for Rotation Equivariant CNNs
In many machine learning tasks it is desirable that a model's prediction transforms in an equivariant way under transformations of its input. Convolutional neural networks (CNNs) implement translational equivariance by construction; for other transformations, however, they are compelled to learn the proper mapping. In this work, we develop Steerable Filter CNNs (SFCNNs) which achieve joint equivariance under translations and rotations by design. The proposed architecture employs steerable filters to efficiently compute orientation dependent responses for many orientations without suffering interpolation artifacts from filter rotation. We utilize group convolutions which guarantee an equivariant mapping. In addition, we generalize He's weight initialization scheme to filters which are defined as a linear combination of a system of atomic filters. Numerical experiments show a substantial enhancement of the sample complexity with a growing number of sampled filter orientations and confirm that the network generalizes learned patterns over orientations. The proposed approach achieves state-of-the-art on the rotated MNIST benchmark and on the ISBI 2012 2D EM segmentation challenge.
Code (0)
등록된 구현이 없습니다.
Tasks
Breast Tumour ClassificationColorectal Gland Segmentation:Multi-tissue Nucleus SegmentationRotated MNISTSimilar Papers 제목 키워드 기반
Rotation-Scale Equivariant Steerable Filters
Incorporating either rotation equivariance or scale equivariance into CNNs has proved to be effective in improving models' generalization performance. However, jointly integrating rotation and scale equivariance into CNN…
GPUDense Steerable Filter CNNs for Exploiting Rotational Symmetry in Histology Images
Histology images are inherently symmetric under rotation, where each orientation is equally as likely to appear. However, this rotational symmetry is not widely utilised as prior knowledge in modern Convolutional Neural …
Breast Tumour ClassificationColorectal Gland Segmentation:Multi-tissue Nucleus SegmentationNuclear Segmentation+1PDO-s3DCNNs: Partial Differential Operator Based Steerable 3D CNNs
Steerable models can provide very general and flexible equivariance by formulating equivariance requirements in the language of representation theory and feature fields, which has been recognized to be effective for many…
RetrievalRotDCF: Decomposition of Convolutional Filters for Rotation-Equivariant Deep Networks
Explicit encoding of group actions in deep features makes it possible for convolutional neural networks (CNNs) to handle global deformations of images, which is critical to success in many vision tasks. This paper propos…
Local Rotation Invariance in 3D CNNs
Locally Rotation Invariant (LRI) image analysis was shown to be fundamental in many applications and in particular in medical imaging where local structures of tissues occur at arbitrary rotations. LRI constituted the co…
Data AugmentationTexture Classification