Efficient Graph Neural Architecture Search
Recently, graph neural networks (GNN) have been demonstrated effective in various graph-based tasks. To obtain state-of-the-art (SOAT) data-specific GNN architectures, researchers turn to the neural architecture search (NAS) methods. However, it remains to be a challenging problem to conduct efficient architecture search for GNN. In this work, we present a novel framework for Efficient GrAph Neural architecture search (EGAN). By designing a novel and expressive search space, an efficient one-shot NAS method based on stochastic relaxation and natural gradient is proposed. Further, to enable architecture search in large graphs, a transfer learning paradigm is designed. Extensive experiments, including node-level and graph-level tasks, are conducted. The results show that the proposed EGAN can obtain SOTA data-specific architectures, and reduce the search cost by two orders of magnitude compared to existing NAS baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Neural Architecture SearchTransfer LearningSimilar Papers 제목 키워드 기반
Towards Lightweight Graph Neural Network Search with Curriculum Graph Sparsification
Graph Neural Architecture Search (GNAS) has achieved superior performance on various graph-structured tasks. However, existing GNAS studies overlook the applications of GNAS in resource-constraint scenarios. This paper p…
Graph Neural NetworkNetwork PruningNeural Architecture SearchNode ClassificationCausal-aware Graph Neural Architecture Search under Distribution Shifts
Graph NAS has emerged as a promising approach for autonomously designing GNN architectures by leveraging the correlations between graphs and architectures. Existing methods fail to generalize under distribution shifts th…
Graph EmbeddingNeural Architecture SearchOut-of-Distribution GeneralizationGraphPAS: Parallel Architecture Search for Graph Neural Networks
Graph neural architecture search has received a lot of attention as Graph Neural Networks (GNNs) has been successfully applied on the non-Euclidean data recently. However, exploring all possible GNNs architectures in the…
Neural Architecture SearchEfficient and Explainable Graph Neural Architecture Search via Monte-Carlo Tree Search
Graph neural networks (GNNs) are powerful tools for performing data science tasks in various domains. Although we use GNNs in wide application scenarios, it is a laborious task for researchers and practitioners to design…
Neural Architecture SearchGraph Differentiable Architecture Search with Structure Learning
Discovering ideal Graph Neural Networks (GNNs) architectures for different tasks is labor intensive and time consuming. To save human efforts, Neural Architecture Search (NAS) recently has been used to automatically disc…
DenoisingGraph structure learningNeural Architecture Search