paper-with-me

홈 › Papers

An Uncoupled Training Architecture for Large Graph Learning

2020-03-21 · Dalong Yang, Chuan Chen, Youhao Zheng, Zibin Zheng, Shih-wei Liao

Graph Convolutional Network (GCN) has been widely used in graph learning tasks. However, GCN-based models (GCNs) is an inherently coupled training framework repetitively conducting the complex neighboring aggregation, which leads to the limitation of flexibility in processing large-scale graph. With the depth of layers increases, the computational and memory cost of GCNs grow explosively due to the recursive neighborhood expansion. To tackle these issues, we present Node2Grids, a flexible uncoupled training framework that leverages the independent mapped data for obtaining the embedding. Instead of directly processing the coupled nodes as GCNs, Node2Grids supports a more efficacious method in practice, mapping the coupled graph data into the independent grid-like data which can be fed into the efficient Convolutional Neural Network (CNN). This simple but valid strategy significantly saves memory and computational resource while achieving comparable results with the leading GCN-based models. Specifically, by ranking each node's influence through degree, Node2Grids selects the most influential first-order as well as second-order neighbors with central node fusion information to construct the grid-like data. For further improving the efficiency of downstream tasks, a simple CNN-based neural network is employed to capture the significant information from the mapped grid-like data. Moreover, the grid-level attention mechanism is implemented, which enables implicitly specifying the different weights for neighboring nodes with different influences. In addition to the typical transductive and inductive learning tasks, we also verify our framework on million-scale graphs to demonstrate the superiority of the proposed Node2Grids model against the state-of-the-art GCN-based approaches.

📄 PDF Abstract BibTeX arXiv:2003.09638

Code (0)

등록된 구현이 없습니다.

Tasks

Graph LearningInductive Learning

Methods 이 논문이 사용한 방법론

GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

Chaotic attractor reconstruction using small reservoirs - the influence of topology

2024-02-23 · Lina Jaurigue

Forecasting timeseries based upon measured data is needed in a wide range of applications and has been the subject of extensive research. A particularly challenging task is the forecasting of timeseries generated by chao…

Uncoupled Regression from Pairwise Comparison Data

2019-05-31 · NeurIPS 2019 12 · Liyuan Xu, Junya Honda, Gang Niu, Masashi Sugiyama

Uncoupled regression is the problem to learn a model from unlabeled data and the set of target values while the correspondence between them is unknown. Such a situation arises in predicting anonymized targets that involv…

Learning-To-Rankregression

Vestibular reservoir computing

2026-04-10 · Smita Deb, Shirin Panahi, Mulugeta Haile, Ying-Cheng Lai arxiv

Reservoir computing (RC) is a computational framework known for its training efficiency, making it ideal for physical hardware implementations. However, realizing the complex interconnectivity of traditional reservoirs i…

General Identifiability and Achievability for Causal Representation Learning

2023-10-24 · Burak Varici, Emre Acartürk, Karthikeyan Shanmugam, Ali Tajer

This paper focuses on causal representation learning (CRL) under a general nonparametric latent causal model and a general transformation model that maps the latent data to the observational data. It establishes identifi…

Representation Learning

Beyond Time-Average Convergence: Near-Optimal Uncoupled Online Learning via Clairvoyant Multiplicative Weights Update

2021-11-29 · Georgios Piliouras, Ryann Sim, Stratis Skoulakis

In this paper, we provide a novel and simple algorithm, Clairvoyant Multiplicative Weights Updates (CMWU) for regret minimization in general games. CMWU effectively corresponds to the standard MWU algorithm but where all…