paper-with-me

홈 › Papers

Equivariance-bridged SO(2)-Invariant Representation Learning using Graph Convolutional Network

2021-06-18 · Sungwon Hwang, Hyungtae Lim, Hyun Myung

Training a Convolutional Neural Network (CNN) to be robust against rotation has mostly been done with data augmentation. In this paper, another progressive vision of research direction is highlighted to encourage less dependence on data augmentation by achieving structural rotational invariance of a network. The deep equivariance-bridged SO(2) invariant network is proposed to echo such vision. First, Self-Weighted Nearest Neighbors Graph Convolutional Network (SWN-GCN) is proposed to implement Graph Convolutional Network (GCN) on the graph representation of an image to acquire rotationally equivariant representation, as GCN is more suitable for constructing deeper network than spectral graph convolution-based approaches. Then, invariant representation is eventually obtained with Global Average Pooling (GAP), a permutation-invariant operation suitable for aggregating high-dimensional representations, over the equivariant set of vertices retrieved from SWN-GCN. Our method achieves the state-of-the-art image classification performance on rotated MNIST and CIFAR-10 images, where the models are trained with a non-augmented dataset only. Quantitative validations over invariance of the representations also demonstrate strong invariance of deep representations of SWN-GCN over rotations.

📄 PDF Abstract BibTeX arXiv:2106.09996

Code (2)

deepshwang/swn_gcn pytorch
deepshwang/wn_gcn pytorch

Tasks

Data Augmentationimage-classificationImage ClassificationRepresentation LearningRotated MNIST

Methods 이 논문이 사용한 방법론

Average Pooling 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

Scale equivariance in CNNs with vector fields

2018-07-31 · Diego Marcos, Benjamin Kellenberger, Sylvain Lobry, Devis Tuia

We study the effect of injecting local scale equivariance into Convolutional Neural Networks. This is done by applying each convolutional filter at multiple scales. The output is a vector field encoding for the maximally…

General Classification

Bridged-GNN: Knowledge Bridge Learning for Effective Knowledge Transfer

2023-08-18 · Wendong Bi, Xueqi Cheng, Bingbing Xu, Xiaoqian Sun 외

The data-hungry problem, characterized by insufficiency and low-quality of data, poses obstacles for deep learning models. Transfer learning has been a feasible way to transfer knowledge from high-quality external data o…

GRAPH DOMAIN ADAPTATIONRetrievalTransfer Learning

ChebLieNet: Invariant Spectral Graph NNs Turned Equivariant by Riemannian Geometry on Lie Groups

2021-11-23 · NeurIPS 2021 12 · Hugo Aguettaz, Erik J. Bekkers, Michaël Defferrard

We introduce ChebLieNet, a group-equivariant method on (anisotropic) manifolds. Surfing on the success of graph- and group-based neural networks, we take advantage of the recent developments in the geometric deep learnin…

Graph Neural Network

Importance of equivariant and invariant symmetries for fluid flow modeling

2023-05-03 · Varun Shankar, Shivam Barwey, Zico Kolter, Romit Maulik 외

Graph neural networks (GNNs) have shown promise in learning unstructured mesh-based simulations of physical systems, including fluid dynamics. In tandem, geometric deep learning principles have informed the development o…

Capacity of Group-invariant Linear Readouts from Equivariant Representations: How Many Objects can be Linearly Classified Under All Possible Views?

2021-10-14 · ICLR 2022 4 · Matthew Farrell, Blake Bordelon, Shubhendu Trivedi, Cengiz Pehlevan

Equivariance has emerged as a desirable property of representations of objects subject to identity-preserving transformations that constitute a group, such as translations and rotations. However, the expressivity of a re…

All