paper-with-me

홈 › Papers

DeepGCNs: Can GCNs Go as Deep as CNNs?

2019-04-07 · ICCV 2019 10 · Guohao Li, Matthias Müller, Ali Thabet, Bernard Ghanem

Convolutional Neural Networks (CNNs) achieve impressive performance in a wide variety of fields. Their success benefited from a massive boost when very deep CNN models were able to be reliably trained. Despite their merits, CNNs fail to properly address problems with non-Euclidean data. To overcome this challenge, Graph Convolutional Networks (GCNs) build graphs to represent non-Euclidean data, borrow concepts from CNNs, and apply them in training. GCNs show promising results, but they are usually limited to very shallow models due to the vanishing gradient problem. As a result, most state-of-the-art GCN models are no deeper than 3 or 4 layers. In this work, we present new ways to successfully train very deep GCNs. We do this by borrowing concepts from CNNs, specifically residual/dense connections and dilated convolutions, and adapting them to GCN architectures. Extensive experiments show the positive effect of these deep GCN frameworks. Finally, we use these new concepts to build a very deep 56-layer GCN, and show how it significantly boosts performance (+3.7% mIoU over state-of-the-art) in the task of point cloud semantic segmentation. We believe that the community can greatly benefit from this work, as it opens up many opportunities for advancing GCN-based research.

📄 PDF Abstract BibTeX arXiv:1904.03751

Code (1)

lightaime/deep_gcns 공식 구현 tf

Tasks

3D Semantic SegmentationGraph ClassificationNode ClassificationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Graph Convolutional Networks 설명 없음
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

DeepGCNs: Making GCNs Go as Deep as CNNs

2019-10-15 · Guohao Li, Matthias Müller, Guocheng Qian, Itzel C. Delgadillo 외

Convolutional Neural Networks (CNNs) have been very successful at solving a variety of computer vision tasks such as object classification and detection, semantic segmentation, activity understanding, to name just a few.…

3D Point Cloud Classification3D Semantic SegmentationNode ClassificationSegmentation+1

DeeperGCN: All You Need to Train Deeper GCNs

2020-06-13 · Guohao Li, Chenxin Xiong, Ali Thabet, Bernard Ghanem

Graph Convolutional Networks (GCNs) have been drawing significant attention with the power of representation learning on graphs. Unlike Convolutional Neural Networks (CNNs), which are able to take advantage of stacking v…

AllGraph LearningGraph Property PredictionNode Property Prediction+2

Unified GCNs: Towards Connecting GCNs with CNNs

2022-04-26 · Ziyan Zhang, Bo Jiang, Bin Luo

Graph Convolutional Networks (GCNs) have been widely demonstrated their powerful ability in graph data representation and learning. Existing graph convolution layers are mainly designed based on graph signal processing a…

Image Classification with Hierarchical Multigraph Networks

2019-07-21 · Boris Knyazev, Xiao Lin, Mohamed R. Amer, Graham W. Taylor

Graph Convolutional Networks (GCNs) are a class of general models that can learn from graph structured data. Despite being general, GCNs are admittedly inferior to convolutional neural networks (CNNs) when applied to vis…

ClassificationGeneral Classificationimage-classificationImage Classification+2

SGAS: Sequential Greedy Architecture Search

2019-11-30 · CVPR 2020 6 · Guohao Li, Guocheng Qian, Itzel C. Delgadillo, Matthias Müller 외

Architecture design has become a crucial component of successful deep learning. Recent progress in automatic neural architecture search (NAS) shows a lot of promise. However, discovered architectures often fail to genera…

ClassificationGeneral Classificationimage-classificationImage Classification+3