Deep Neural Networks for Rotation-Invariance Approximation and Learning
Based on the tree architecture, the objective of this paper is to design deep neural networks with two or more hidden layers (called deep nets) for realization of radial functions so as to enable rotational invariance for near-optimal function approximation in an arbitrarily high dimensional Euclidian space. It is shown that deep nets have much better performance than shallow nets (with only one hidden layer) in terms of approximation accuracy and learning capabilities. In particular, for learning radial functions, it is shown that near-optimal rate can be achieved by deep nets but not by shallow nets. Our results illustrate the necessity of depth in neural network design for realization of rotation-invariance target functions.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Towards Rotation Invariance in Object Detection
Rotation augmentations generally improve a model's invariance/equivariance to rotation - except in object detection. In object detection the shape is not known, therefore rotation creates a label ambiguity. We show that …
Objectobject-detectionObject DetectionFacial Expression Classification Using Rotation Slepian-based Moment Invariants
Rotation moment invariants have been of great interest in image processing and pattern recognition. This paper presents a novel kind of rotation moment invariants based on the Slepian functions, which were originally int…
ClassificationGeneral ClassificationTime SeriesTime Series AnalysisSelective Disk Bispectrum: A Complete and Rotation Invariant Image Descriptor
Rotation invariance is a fundamental requirement across many computer vision tasks. Historically, this inductive bias has been encoded through hand-crafted rotation-invariant representations. These are compact, interpret…
Are the Latent Representations of Foundation Models for Pathology Invariant to Rotation?
Self-supervised foundation models for digital pathology encode small patches from H\&E whole slide images into latent representations used for downstream tasks. However, the invariance of these representations to patch r…
Inductive Biaswhole slide imagesWho Handles Orientation? Investigating Invariance in Feature Matching
Finding matching keypoints between images is a core problem in 3D computer vision. However, modern matchers struggle with large in-plane rotations. A straightforward mitigation is to learn rotation invariance via data au…
Data AugmentationImage Matching