Superpixel Image Classification with Graph Attention Networks
This paper presents a methodology for image classification using Graph Neural Network (GNN) models. We transform the input images into region adjacency graphs (RAGs), in which regions are superpixels and edges connect neighboring superpixels. Our experiments suggest that Graph Attention Networks (GATs), which combine graph convolutions with self-attention mechanisms, outperforms other GNN models. Although raw image classifiers perform better than GATs due to information loss during the RAG generation, our methodology opens an interesting avenue of research on deep learning beyond rectangular-gridded images, such as 360-degree field of view panoramas. Traditional convolutional kernels of current state-of-the-art methods cannot handle panoramas, whereas the adapted superpixel algorithms and the resulting region adjacency graphs can naturally feed a GNN, without topology issues.
Code (1)
Tasks
ClassificationGeneral ClassificationGraph AttentionGraph Neural Networkimage-classificationImage ClassificationRAGSuperpixel Image ClassificationSuperpixelsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Is an Image Also Worth 16x16=256 Superpixels? A Framework for Attentional Image Classification
Superpixel-based image classification has traditionally leveraged graph neural networks (GNNs) for processing irregular image representations. Recent advances in computer vision, driven by Vision Transformers (ViTs), hav…
Superpixel Image ClassificationDomain GeneralizationImage Classification using Graph Neural Network and Multiscale Wavelet Superpixels
Prior studies using graph neural networks (GNNs) for image classification have focused on graphs generated from a regular grid of pixels or similar-sized superpixels. In the latter, a single target number of superpixels …
ClassificationGraph ClassificationGraph Neural Networkimage-classification+2Learning from multiscale wavelet superpixels using GNN with spatially heterogeneous pooling
Neural networks have become the standard for image classification tasks. On one hand, convolutional neural networks (CNNs) achieve state-of-the-art performance by learning from a regular grid representation of images. On…
General ClassificationGraph Classificationimage-classificationImage Classification+1Spatio-Temporal driven Attention Graph Neural Network with Block Adjacency matrix (STAG-NN-BA)
Despite the recent advances in deep neural networks, standard convolutional kernels limit the applications of these networks to the Euclidean domain only. Considering the geodesic nature of the measurement of the earth's…
Graph AttentionGraph Neural NetworkImage SegmentationRAG+2Graph-Weighted Contrastive Learning for Semi-Supervised Hyperspectral Image Classification
Most existing graph-based semi-supervised hyperspectral image classification methods rely on superpixel partitioning techniques. However, they suffer from misclassification of certain pixels due to inaccuracies in superp…
Contrastive LearningHyperspectral Image Classificationimage-classificationImage Classification