paper-with-me

홈 › Papers

Multi-scale Graph Convolutional Networks with Self-Attention

2021-12-04 · Zhilong Xiong, Jia Cai

Graph convolutional networks (GCNs) have achieved remarkable learning ability for dealing with various graph structural data recently. In general, deep GCNs do not work well since graph convolution in conventional GCNs is a special form of Laplacian smoothing, which makes the representation of different nodes indistinguishable. In the literature, multi-scale information was employed in GCNs to enhance the expressive power of GCNs. However, over-smoothing phenomenon as a crucial issue of GCNs remains to be solved and investigated. In this paper, we propose two novel multi-scale GCN frameworks by incorporating self-attention mechanism and multi-scale information into the design of GCNs. Our methods greatly improve the computational efficiency and prediction accuracy of the GCNs model. Extensive experiments on both node classification and graph classification demonstrate the effectiveness over several state-of-the-art GCNs. Notably, the proposed two architectures can efficiently mitigate the over-smoothing problem of GCNs, and the layer of our model can even be increased to $64$.

📄 PDF Abstract BibTeX arXiv:2112.03262

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyGraph ClassificationNode Classification

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

Multi-Scale Spatial-Temporal Self-Attention Graph Convolutional Networks for Skeleton-based Action Recognition

2024-04-03 · Ikuo Nakamura

Skeleton-based gesture recognition methods have achieved high success using Graph Convolutional Network (GCN). In addition, context-dependent adaptive topology as a neighborhood vertex information and attention mechanism…

Action RecognitionGesture RecognitionSkeleton Based Action Recognition

Multi-hop graph transformer network for 3D human pose estimation

2024-05-05 · Zaedul Islam, A. Ben Hamza

Accurate 3D human pose estimation is a challenging task due to occlusion and depth ambiguity. In this paper, we introduce a multi-hop graph transformer network designed for 2D-to-3D human pose estimation in videos by lev…

3D Human Pose EstimationGraph AttentionPose Estimation

Hierarchical Attention Models for Multi-Relational Graphs

2024-04-14 · Roshni G. Iyer, Wei Wang, Yizhou Sun

We present Bi-Level Attention-Based Relational Graph Convolutional Networks (BR-GCN), unique neural network architectures that utilize masked self-attentional layers with relational graph convolutions, to effectively ope…

Graph AttentionLink PredictionNode ClassificationRelation

Deep Attention-guided Graph Clustering with Dual Self-supervision

2021-11-10 · Zhihao Peng, Hui Liu, Yuheng Jia, Junhui Hou

Existing deep embedding clustering works only consider the deepest layer to learn a feature embedding and thus fail to well utilize the available discriminative information from cluster assignments, resulting performance…

ClusteringDeep AttentionGraph ClusteringTriplet

Joint Self-Attention and Scale-Aggregation for Self-Calibrated Deraining Network

2020-08-06 · Cong Wang, Yutong Wu, Zhixun Su, Junyang Chen

In the field of multimedia, single image deraining is a basic pre-processing work, which can greatly improve the visual effect of subsequent high-level tasks in rainy conditions. In this paper, we propose an effective al…

Rain RemovalSingle Image Deraining