paper-with-me

홈 › Papers

Learning Discrete Adaptive Receptive Fields for Graph Convolutional Networks

2021-01-01 · Xiaojun Ma, Ziyao Li, Lingjun Xu, Guojie Song, Yi Li, Chuan Shi

Different nodes in a graph neighborhood generally yield different importance. In previous work of Graph Convolutional Networks (GCNs), such differences are typically modeled with attention mechanisms. However, as we prove in our paper, soft attention weights suffer from over-smoothness in large neighborhoods. To address this weakness, we introduce a novel framework of conducting graph convolutions, where nodes are discretely selected among multi-hop neighborhoods to construct adaptive receptive fields (ARFs). ARFs enable GCNs to get rid of the over-smoothness of soft attention weights, as well as to efficiently explore long-distance dependencies in graphs. We further propose GRARF (GCN with Reinforced Adaptive Receptive Fields) as an instance, where an optimal policy of constructing ARFs is learned with reinforcement learning. GRARF achieves or matches state-of-the-art performances on public datasets from different domains. Our further analysis corroborates that GRARF is more robust than attention models against neighborhood noises.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Graph Convolutional Networks 설명 없음

Similar Papers 제목 키워드 기반

Skeleton-Based Action Recognition With Shift Graph Convolutional Network

2020-06-01 · CVPR 2020 6 · Ke Cheng, Yifan Zhang, Xiangyu He, Weihan Chen 외

Action recognition with skeleton data is attracting more attention in computer vision. Recently, graph convolutional networks (GCNs), which model the human body skeletons as spatiotemporal graphs, have obtained remarkabl…

Action RecognitionSkeleton Based Action Recognition

Scale-Adaptive Convolutions for Scene Parsing

2017-10-01 · ICCV 2017 10 · Rui Zhang, Sheng Tang, Yongdong Zhang, Jintao Li 외

Many existing scene parsing methods adopt Convolutional Neural Networks with fixed-size receptive fields, which frequently result in inconsistent predictions of large objects and invisibility of small objects. To tackle …

GPUregressionScene Parsing

Adaptive Multi-receptive Field Spatial-Temporal Graph Convolutional Network for Traffic Forecasting

2021-11-01 · Xing Wang, Juan Zhao, Lin Zhu, Xu Zhou 외

Mobile network traffic forecasting is one of the key functions in daily network operation. A commercial mobile network is large, heterogeneous, complex and dynamic. These intrinsic features make mobile network traffic fo…

Decoder

What are the Receptive, Effective Receptive, and Projective Fields of Neurons in Convolutional Neural Networks?

2017-05-19 · Hung Le, Ali Borji

In this work, we explain in detail how receptive fields, effective receptive fields, and projective fields of neurons in different layers, convolution or pooling, of a Convolutional Neural Network (CNN) are calculated. W…

Learning Adaptive Receptive Fields for Deep Image Parsing Network

2017-07-01 · CVPR 2017 7 · Zhen Wei, Yao Sun, Jinqiao Wang, Hanjiang Lai 외

In this paper, we introduce a novel approach to regulate receptive field in deep image parsing network automatically. Unlike previous works which have stressed much importance on obtaining better receptive fields using m…

Face Parsing