paper-with-me

Papers

Simplification of Graph Convolutional Networks: A Matrix Factorization-based Perspective

2020-07-17 · Qiang Liu, Haoli Zhang, Zhaocheng Liu

In recent years, substantial progress has been made on Graph Convolutional Networks (GCNs). However, the computing of GCN usually requires a large memory space for keeping the entire graph. In consequence, GCN is not flexible enough, especially for large scale graphs in complex real-world applications. Fortunately, methods based on Matrix Factorization (MF) naturally support constructing mini-batches, and thus are more friendly to distributed computing compared with GCN. Accordingly, in this paper, we analyze the connections between GCN and MF, and simplify GCN as matrix factorization with unitization and co-training. Furthermore, under the guidance of our analysis, we propose an alternative model to GCN named Unitized and Co-training Matrix Factorization (UCMF). Extensive experiments have been conducted on several real-world datasets. On the task of semi-supervised node classification, the experimental results illustrate that UCMF achieves similar or superior performances compared with GCN. Meanwhile, distributed UCMF significantly outperforms distributed GCN methods, which shows that UCMF can greatly benefit large scale and complex real-world applications. Moreover, we have also conducted experiments on a typical task of graph embedding, i.e., community detection, and the proposed UCMF model outperforms several representative graph embedding models.

📄 PDF Abstract BibTeX arXiv:2007.09036

Code (0)

등록된 구현이 없습니다.

Tasks

Community DetectionDistributed ComputingGraph EmbeddingNode Classification

Methods 이 논문이 사용한 방법론

Graph Convolutional Networks 설명 없음
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

Graph Regularized Nonnegative Matrix Factorization for Data Representation

2011-08-01 · IEEE Transactions on Pattern Analysis and Machine Intelligence 2011 8 · Deng Cai, Xiaofei He, Jiawei Han, Thomas S. Huang

Matrix factorization techniques have been frequently applied in information retrieval, computer vision, and pattern recognition. Among them, Nonnegative Matrix Factorization (NMF) has received considerable attention due…

Information RetrievalRetrieval

Unifying Graph Convolutional Networks as Matrix Factorization

2020-01-01 · ICLR 2020 1 · Zhaocheng Liu, Qiang Liu, Haoli Zhang, Jun Zhu

In recent years, substantial progress has been made on graph convolutional networks (GCN). In this paper, for the first time, we theoretically analyze the connections between GCN and matrix factorization (MF), and unify …

Distributed ComputingNode Classification

Sparse Matrix Factorization

2013-11-13 · Behnam Neyshabur, Rina Panigrahy

We investigate the problem of factorizing a matrix into several sparse matrices and propose an algorithm for this under randomness and sparsity assumptions. This problem can be viewed as a simplification of the deep lear…

Deep LearningDictionary Learning

A Non-Negative Factorization approach to node pooling in Graph Convolutional Neural Networks

2019-09-07 · Davide Bacciu, Luigi Di Sotto

The paper discusses a pooling mechanism to induce subsampling in graph structured data and introduces it as a component of a graph convolutional neural network. The pooling mechanism builds on the Non-Negative Matrix Fac…

Graph Classification

Latent Random Steps as Relaxations of Max-Cut, Min-Cut, and More

2023-08-12 · Sudhanshu Chanpuriya, Cameron Musco

Algorithms for node clustering typically focus on finding homophilous structure in graphs. That is, they find sets of similar nodes with many edges within, rather than across, the clusters. However, graphs often also exh…

ClusteringNode Clustering