paper-with-me

홈 › Papers

Demystifying Graph Convolution with a Simple Concatenation

2022-07-18 · Zhiqian Chen, Zonghan Zhang

Graph convolution (GConv) is a widely used technique that has been demonstrated to be extremely effective for graph learning applications, most notably node categorization. On the other hand, many GConv-based models do not quantify the effect of graph topology and node features on performance, and are even surpassed by some models that do not consider graph structure or node properties. We quantify the information overlap between graph topology, node features, and labels in order to determine graph convolution's representation power in the node classification task. In this work, we first determine the linear separability of graph convoluted features using analysis of variance. Mutual information is used to acquire a better understanding of the possible non-linear relationship between graph topology, node features, and labels. Our theoretical analysis demonstrates that a simple and efficient graph operation that concatenates only graph topology and node properties consistently outperforms conventional graph convolution, especially in the heterophily case. Extensive empirical research utilizing a synthetic dataset and real-world benchmarks demonstrates that graph concatenation is a simple but more flexible alternative to graph convolution.

📄 PDF Abstract BibTeX arXiv:2207.12931

Code (0)

등록된 구현이 없습니다.

Tasks

Graph LearningNode Classification

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Demystifying Graph Neural Network Via Graph Filter Assessment

2019-09-25 · Yewen Wang, Ziniu Hu, Yusong Ye, Yizhou Sun

Graph Neural Networks (GNNs) have received tremendous attention recently due to their power in handling graph data for different downstream tasks across different application domains. The key of GNN is its graph convolut…

Graph Neural Network

Caterpillar: A Pure-MLP Architecture with Shifted-Pillars-Concatenation

2023-05-28 · Jin Sun, Xiaoshuang Shi, Zhiyuan Wang, Kaidi Xu 외

Modeling in Computer Vision has evolved to MLPs. Vision MLPs naturally lack local modeling capability, to which the simplest treatment is combined with convolutional layers. Convolution, famous for its sliding window sch…

Computational EfficiencyInductive Bias

Iterative Filter Pruning for Concatenation-based CNN Architectures

2024-05-04 · Svetlana Pavlitska, Oliver Bagge, Federico Peccia, Toghrul Mammadov 외

Model compression and hardware acceleration are essential for the resource-efficient deployment of deep neural networks. Modern object detectors have highly interconnected convolutional layers with concatenations. In thi…

Model Compression

Neighbor-aware informal settlement mapping with graph convolutional networks

2025-09-30 · Thomas Hallopeau, Joris Guérin, Laurent Demagistri, Christovam Barcellos 외 arxiv

Mapping informal settlements is crucial for addressing challenges related to urban planning, public health, and infrastructure in rapidly growing cities. Geospatial machine learning has emerged as a key tool for detectin…

Scene Understanding

XCAT -- Lightweight Quantized Single Image Super-Resolution using Heterogeneous Group Convolutions and Cross Concatenation

2022-08-31 · Mustafa Ayazoglu, Bahri Batuhan Bilecen

We propose a lightweight, single image super-resolution network for mobile devices, named XCAT. XCAT introduces Heterogeneous Group Convolution Blocks with Cross Concatenations (HXBlock). The heterogeneous split of the i…

Data AugmentationGPUImage Super-ResolutionQuantization+1