paper-with-me

홈 › Papers

Accurate Shift Invariant Convolutional Neural Networks Using Gaussian-Hermite Moments

2026-03-17 · Jaspreet Singh, Petra Bosilj, Grzegorz Cielniak arxiv

The convolutional neural networks (CNNs) are not inherently shift invariant or equivariant. The downsampling operation, used in CNNs, is one of the key reasons which breaks the shift invariant property of a CNN. Conversely, downsampling operation is important to improve computational efficiency and increase the area of the receptive field for more contextual information. In this work, we propose Gaussian-Hermite Sampling (GHS), a novel downsampling strategy designed to achieve accurate shift invariance. GHS leverages Gaussian-Hermite polynomials to perform shift-consistent sampling, enabling CNN layers to maintain invariance to arbitrary spatial shifts prior to training. When integrated into standard CNN architectures, the proposed method embeds shift invariance directly at the layer level without requiring architectural modifications or additional training procedures. We evaluate the proposed approach on CIFAR-10, CIFAR-100, and MNIST-rot datasets. Experimental results demonstrate that GHS significantly improves shift consistency, achieving 100% classification consistency under spatial shifts, while also improving classification accuracy compared to baseline CNN models.

📄 PDF Abstract BibTeX arXiv:2603.17098

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Similar Papers 제목 키워드 기반

Translation Insensitive CNNs

2019-11-25 · Ganesh Sundaramoorthi, Timothy E. Wang

We address the problem that state-of-the-art Convolution Neural Networks (CNN) classifiers are not invariant to small shifts. The problem can be solved by the removal of sub-sampling operations such as stride and max poo…

Translation

Gaussian-Hermite Moment Invariants of General Multi-Channel Functions

2022-01-03 · Hanlin Mo, Hua Li, Guoying Zhao

With the development of data acquisition technology, large amounts of multi-channel data are collected and widely used in many fields. Most of them, such as RGB images and vector fields, can be expressed as different typ…

image-classificationImage ClassificationTemplate Matching

Orthonormal Expansions for Translation-Invariant Kernels

2022-06-17 · Filip Tronarp, Toni Karvonen

We present a general Fourier analytic technique for constructing orthonormal basis expansions of translation-invariant kernels from orthonormal bases of $\mathscr{L}_2(\mathbb{R})$. This allows us to derive explicit expa…

Translation

Predicting kernel regression learning curves from only raw data statistics

2025-10-16 · Dhruva Karkada, Joseph Turnbull, Yuxi Liu, James B. Simon arxiv

We study kernel regression with common rotation-invariant kernels on real datasets including CIFAR-5m, SVHN, and ImageNet. We give a theoretical framework that predicts learning curves (test risk vs. sample size) from on…

Minimal Compression of a Radio-Frequency Pulse

2021-10-12 · W. J. Szajnowski

Quadrature amplitude modulation (QAM) and a complementary representation of a causal waveform have been used to develop a sidelobe-free pulse-compression technique. Envelopes of radio-frequency (RF) pulses under study in…