paper-with-me

홈 › Papers

Variational Partial Group Convolutions for Input-Aware Partial Equivariance of Rotations and Color-Shifts

2024-07-05 · Hyunsu Kim, Yegon Kim, Hongseok Yang, Juho Lee

Group Equivariant CNNs (G-CNNs) have shown promising efficacy in various tasks, owing to their ability to capture hierarchical features in an equivariant manner. However, their equivariance is fixed to the symmetry of the whole group, limiting adaptability to diverse partial symmetries in real-world datasets, such as limited rotation symmetry of handwritten digit images and limited color-shift symmetry of flower images. Recent efforts address this limitation, one example being Partial G-CNN which restricts the output group space of convolution layers to break full equivariance. However, such an approach still fails to adjust equivariance levels across data. In this paper, we propose a novel approach, Variational Partial G-CNN (VP G-CNN), to capture varying levels of partial equivariance specific to each data instance. VP G-CNN redesigns the distribution of the output group elements to be conditioned on input data, leveraging variational inference to avoid overfitting. This enables the model to adjust its equivariance levels according to the needs of individual data points. Additionally, we address training instability inherent in discrete group equivariance models by redesigning the reparametrizable distribution. We demonstrate the effectiveness of VP G-CNN on both toy and real-world datasets, including MNIST67-180, CIFAR10, ColorMNIST, and Flowers102. Our results show robust performance, even in uncertainty metrics.

📄 PDF Abstract BibTeX arXiv:2407.04271

Code (1)

yegonkim/partial_equiv 공식 구현 pytorch

Tasks

Variational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

PDO-eConvs: Partial Differential Operator Based Equivariant Convolutions

2020-07-20 · ICML 2020 1 · Zhengyang Shen, Lingshen He, Zhouchen Lin, Jinwen Ma

Recent research has shown that incorporating equivariance into neural network architectures is very helpful, and there have been some works investigating the equivariance of networks under group actions. However, as digi…

image-classificationImage ClassificationRotated MNIST

Group Equivariant Fourier Neural Operators for Partial Differential Equations

2023-06-09 · Jacob Helwig, Xuan Zhang, Cong Fu, Jerry Kurtin 외

We consider solving partial differential equations (PDEs) with Fourier neural operators (FNOs), which operate in the frequency domain. Since the laws of physics do not depend on the coordinate system used to describe the…

Dynamic Group Convolution for Accelerating Convolutional Neural Networks

2020-07-08 · ECCV 2020 8 · Zhuo Su, Linpu Fang, Wenxiong Kang, Dewen Hu 외

Replacing normal convolutions with group convolutions can significantly increase the computational efficiency of modern deep convolutional networks, which has been widely adopted in compact network architecture designs. …

Computational Efficiencyimage-classificationImage Classification

Mask-aware inference with State-Space Models

2026-03-04 · Ignasi Mas, Ramon Morros, Javier-Ruiz Hidalgo, Ivan Huerta arxiv

Many real-world computer vision tasks, such as depth completion, must handle inputs with arbitrarily shaped regions of missing or invalid data. For Convolutional Neural Networks (CNNs), Partial Convolutions solved this b…

Image InpaintingDepth Completion

Steerable Partial Differential Operators for Equivariant Neural Networks

2021-06-18 · ICLR 2022 4 · Erik Jenner, Maurice Weiler

Recent work in equivariant deep learning bears strong similarities to physics. Fields over a base space are fundamental entities in both subjects, as are equivariant maps between these fields. In deep learning, however, …

Deep Learning