paper-with-me

홈 › Papers

Affine Invariance in Continuous-Domain Convolutional Neural Networks

2023-11-13 · Ali Mohaddes, Johannes Lederer

The notion of group invariance helps neural networks in recognizing patterns and features under geometric transformations. Group convolutional neural networks enhance traditional convolutional neural networks by incorporating group-based geometric structures into their design. This research studies affine invariance on continuous-domain convolutional neural networks. Despite other research considering isometric invariance or similarity invariance, we focus on the full structure of affine transforms generated by the group of all invertible $2 \times 2$ real matrices (generalized linear group $\mathrm{GL}_2(\mathbb{R})$). We introduce a new criterion to assess the invariance of two signals under affine transformations. The input image is embedded into the affine Lie group $G_2 = \mathbb{R}^2 \ltimes \mathrm{GL}_2(\mathbb{R})$ to facilitate group convolution operations that respect affine invariance. Then, we analyze the convolution of embedded signals over $G_2$. In sum, our research could eventually extend the scope of geometrical transformations that usual deep-learning pipelines can handle.

📄 PDF Abstract BibTeX arXiv:2311.09245

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Safety verification of Neural-Network-based controllers: a set invariance approach

2023-12-18 · Louis Jouret, Adnane Saoud, Sorin Olaru

This paper presents a novel approach to ensure the safety of continuous-time linear dynamical systems controlled by a neural network (NN) based state-feedback. Our method capitalizes on the use of continuous piece-wise a…

Studying Invariances of Trained Convolutional Neural Networks

2018-03-15 · Charlotte Bunne, Lukas Rahmann, Thomas Wolf

Convolutional Neural Networks (CNNs) define an exceptionally powerful class of models for image classification, but the theoretical background and the understanding of how invariances to certain transformations are learn…

General Classificationimage-classificationImage Classification

Revisiting Data Augmentation for Rotational Invariance in Convolutional Neural Networks

2023-10-12 · Facundo Manuel Quiroga, Franco Ronchetti, Laura Lanzarini, Aurelio Fernandez-Bariviera

Convolutional Neural Networks (CNN) offer state of the art performance in various computer vision tasks. Many of those tasks require different subtypes of affine invariances (scale, rotational, translational) to image tr…

Data Augmentationimage-classificationImage Classification

AffineLens: Capturing the Continuous Piecewise Affine Functions of Neural Networks

2026-05-07 · Yi Wei, Xuan Qi, Furao Shen, Jian Zhao 외 arxiv

Piecewise affine neural networks (PANNs) provide a principled geometric perspective on neural network expressivity by characterizing the input--output map as a continuous piecewise affine (CPA) function whose complexity …

A Coordinate-Free Construction of Scalable Natural Gradient

2018-08-30 · Kevin Luk, Roger Grosse

Most neural networks are trained using first-order optimization methods, which are sensitive to the parameterization of the model. Natural gradient descent is invariant to smooth reparameterizations because it is defined…