paper-with-me

홈 › Papers

Unified GCNs: Towards Connecting GCNs with CNNs

2022-04-26 · Ziyan Zhang, Bo Jiang, Bin Luo

Graph Convolutional Networks (GCNs) have been widely demonstrated their powerful ability in graph data representation and learning. Existing graph convolution layers are mainly designed based on graph signal processing and transform aspect which usually suffer from some limitations, such as over-smoothing, over-squashing and non-robustness, etc. As we all know that Convolution Neural Networks (CNNs) have received great success in many computer vision and machine learning. One main aspect is that CNNs leverage many learnable convolution filters (kernels) to obtain rich feature descriptors and thus can have high capacity to encode complex patterns in visual data analysis. Also, CNNs are flexible in designing their network architecture, such as MobileNet, ResNet, Xception, etc. Therefore, it is natural to arise a question: can we design graph convolutional layer as flexibly as that in CNNs? Innovatively, in this paper, we consider connecting GCNs with CNNs deeply from a general perspective of depthwise separable convolution operation. Specifically, we show that GCN and GAT indeed perform some specific depthwise separable convolution operations. This novel interpretation enables us to better understand the connections between GCNs (GCN, GAT) and CNNs and further inspires us to design more Unified GCNs (UGCNs). As two showcases, we implement two UGCNs, i.e., Separable UGCN (S-UGCN) and General UGCN (G-UGCN) for graph data representation and learning. Promising experiments on several graph representation benchmarks demonstrate the effectiveness and advantages of the proposed UGCNs.

📄 PDF Abstract BibTeX arXiv:2204.12300

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Residual Connection 설명 없음
Batch Normalization 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Kaiming Initialization 설명 없음
Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…

Similar Papers 제목 키워드 기반

DeepGCNs: Making GCNs Go as Deep as CNNs

2019-10-15 · Guohao Li, Matthias Müller, Guocheng Qian, Itzel C. Delgadillo 외

Convolutional Neural Networks (CNNs) have been very successful at solving a variety of computer vision tasks such as object classification and detection, semantic segmentation, activity understanding, to name just a few.…

3D Point Cloud Classification3D Semantic SegmentationNode ClassificationSegmentation+1

Image Classification with Hierarchical Multigraph Networks

2019-07-21 · Boris Knyazev, Xiao Lin, Mohamed R. Amer, Graham W. Taylor

Graph Convolutional Networks (GCNs) are a class of general models that can learn from graph structured data. Despite being general, GCNs are admittedly inferior to convolutional neural networks (CNNs) when applied to vis…

ClassificationGeneral Classificationimage-classificationImage Classification+2

Graph Convolutional Networks for Hyperspectral Image Classification

2020-08-06 · Danfeng Hong, Lianru Gao, Jing Yao, Bing Zhang 외

To read the final version please go to IEEE TGRS on IEEE Xplore. Convolutional neural networks (CNNs) have been attracting increasing attention in hyperspectral (HS) image classification, owing to their ability to captur…

ClassificationGeneral ClassificationHyperspectral Image Classificationimage-classification+1

Dimensional Reweighting Graph Convolution Networks

2019-09-25 · Xu Zou, Qiuye Jia, Jianwei Zhang, Chang Zhou 외

In this paper, we propose a method named Dimensional reweighting Graph Convolutional Networks (DrGCNs), to tackle the problem of variance between dimensional information in the node representations of GCNs. We prove that…

Node Classification

DeepGCNs: Can GCNs Go as Deep as CNNs?

2019-04-07 · ICCV 2019 10 · Guohao Li, Matthias Müller, Ali Thabet, Bernard Ghanem

Convolutional Neural Networks (CNNs) achieve impressive performance in a wide variety of fields. Their success benefited from a massive boost when very deep CNN models were able to be reliably trained. Despite their meri…

3D Semantic SegmentationGraph ClassificationNode ClassificationSemantic Segmentation