paper-with-me

홈 › Papers

DeepGCNs: Making GCNs Go as Deep as CNNs

2019-10-15 · Guohao Li, Matthias Müller, Guocheng Qian, Itzel C. Delgadillo, Abdulellah Abualshour, Ali Thabet, Bernard Ghanem

Convolutional Neural Networks (CNNs) have been very successful at solving a variety of computer vision tasks such as object classification and detection, semantic segmentation, activity understanding, to name just a few. One key enabling factor for their great performance has been the ability to train very deep networks. Despite their huge success in many tasks, CNNs do not work well with non-Euclidean data, which is prevalent in many real-world applications. Graph Convolutional Networks (GCNs) offer an alternative that allows for non-Eucledian data input to a neural network. While GCNs already achieve encouraging results, they are currently limited to architectures with a relatively small number of layers, primarily due to vanishing gradients during training. This work transfers concepts such as residual/dense connections and dilated convolutions from CNNs to GCNs in order to successfully train very deep GCNs. We show the benefit of using deep GCNs (with as many as 112 layers) experimentally across various datasets and tasks. Specifically, we achieve very promising performance in part segmentation and semantic segmentation on point clouds and in node classification of protein functions across biological protein-protein interaction (PPI) graphs. We believe that the insights in this work will open avenues for future research on GCNs and their application to further tasks not explored in this paper. The source code for this work is available at https://github.com/lightaime/deep_gcns_torch and https://github.com/lightaime/deep_gcns for PyTorch and TensorFlow implementation respectively.

📄 PDF Abstract BibTeX arXiv:1910.06849

Code (4)

lightaime/deep_gcns 공식 구현 tf
lightaime/deep_gcns_torch 공식 구현 pytorch
lightaime/deep_gcns_torch/tree/master/examples/ogb pytorch
lightaime/deep_gcns_torch/tree/master/examples/ogb_eff/ogbn_arxiv_dgl pytorch

Tasks

3D Point Cloud Classification3D Semantic SegmentationNode ClassificationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Graph Convolutional Networks 설명 없음

Similar Papers 제목 키워드 기반

DeepGCNs: Can GCNs Go as Deep as CNNs?

2019-04-07 · ICCV 2019 10 · Guohao Li, Matthias Müller, Ali Thabet, Bernard Ghanem

Convolutional Neural Networks (CNNs) achieve impressive performance in a wide variety of fields. Their success benefited from a massive boost when very deep CNN models were able to be reliably trained. Despite their meri…

3D Semantic SegmentationGraph ClassificationNode ClassificationSemantic Segmentation

DeeperGCN: All You Need to Train Deeper GCNs

2020-06-13 · Guohao Li, Chenxin Xiong, Ali Thabet, Bernard Ghanem

Graph Convolutional Networks (GCNs) have been drawing significant attention with the power of representation learning on graphs. Unlike Convolutional Neural Networks (CNNs), which are able to take advantage of stacking v…

AllGraph LearningGraph Property PredictionNode Property Prediction+2

Unified GCNs: Towards Connecting GCNs with CNNs

2022-04-26 · Ziyan Zhang, Bo Jiang, Bin Luo

Graph Convolutional Networks (GCNs) have been widely demonstrated their powerful ability in graph data representation and learning. Existing graph convolution layers are mainly designed based on graph signal processing a…

Image Classification with Hierarchical Multigraph Networks

2019-07-21 · Boris Knyazev, Xiao Lin, Mohamed R. Amer, Graham W. Taylor

Graph Convolutional Networks (GCNs) are a class of general models that can learn from graph structured data. Despite being general, GCNs are admittedly inferior to convolutional neural networks (CNNs) when applied to vis…

ClassificationGeneral Classificationimage-classificationImage Classification+2

SGAS: Sequential Greedy Architecture Search

2019-11-30 · CVPR 2020 6 · Guohao Li, Guocheng Qian, Itzel C. Delgadillo, Matthias Müller 외

Architecture design has become a crucial component of successful deep learning. Recent progress in automatic neural architecture search (NAS) shows a lot of promise. However, discovered architectures often fail to genera…

ClassificationGeneral Classificationimage-classificationImage Classification+3