paper-with-me

홈 › Papers

Robust Graph Representation Learning via Neural Sparsification

2020-01-01 · ICML 2020 1 · Cheng Zheng, Bo Zong, Wei Cheng, Dongjin Song, Jingchao Ni, Wenchao Yu, Haifeng Chen, Wei Wang

Graph representation learning serves as the core of important prediction tasks, ranging from product recommendation to fraud detection. Real-life graphs usually have complex information in the local neighborhood, where each node is described by a rich set of features and connects to dozens or even hundreds of neighbors. Despite the success of neighborhood aggregation in graph neural networks, task-irrelevant information is mixed into nodes' neighborhood, making learned models suffer from sub-optimal generalization performance. In this paper, we present NeuralSparse, a supervised graph sparsification technique that improves generalization power by learning to remove potentially task-irrelevant edges from input graphs. Our method takes both structural and non-structural information as input, utilizes deep neural networks to parameterize sparsification processes, and optimizes the parameters by feedback signals from downstream tasks. Under the NeuralSparse framework, supervised graph sparsification could seamlessly connect with existing graph neural networks for more robust performance. Experimental results on both benchmark and private datasets show that NeuralSparse can yield up to 7.2% improvement in testing accuracy when working with existing graph neural networks on node classification tasks.

📄 PDF Abstract BibTeX

Code (1)

Armxyz1/NeuralSparse-PyTorch pytorch

Tasks

Fraud DetectionGraph Representation LearningNode ClassificationProduct RecommendationRepresentation Learning

Similar Papers 제목 키워드 기반

Spectral Graph Sparsification Preserves Representation Geometry in Graph Neural Networks

2026-05-01 · Sanjukta Krishnagopal arxiv

Spectral graph sparsification is a classical tool for reducing graph complexity while preserving Laplacian quadratic forms. In graph neural networks (GNNs), sparsification is often used to accelerate computation while ma…

Heterogeneous Graph Sparsification for Efficient Representation Learning

2022-11-14 · Chandan Chunduru, Chun Jiang Zhu, Blake Gains, Jinbo Bi

Graph sparsification is a powerful tool to approximate an arbitrary graph and has been used in machine learning over homogeneous graphs. In heterogeneous graphs such as knowledge graphs, however, sparsification has not b…

Graph LearningKnowledge GraphsRepresentation Learning

Less Is More - On the Importance of Sparsification for Transformers and Graph Neural Networks for TSP

2024-03-25 · Attila Lischka, Jiaming Wu, Rafael Basso, Morteza Haghir Chehreghani 외

Most of the recent studies tackling routing problems like the Traveling Salesman Problem (TSP) with machine learning use a transformer or Graph Neural Network (GNN) based encoder architecture. However, many of them apply…

Graph Neural NetworkTraveling Salesman Problem

SF-GRASS: Solver-Free Graph Spectral Sparsification

2020-08-17 · Ying Zhang, Zhiqiang Zhao, Zhuo Feng

Recent spectral graph sparsification techniques have shown promising performance in accelerating many numerical and graph algorithms, such as iterative methods for solving large sparse matrices, spectral partitioning of …

Representation Learning

Faster Spectral Density Estimation and Sparsification in the Nuclear Norm

2024-06-11 · Yujia Jin, Ishani Karmarkar, Christopher Musco, Aaron Sidford 외

We consider the problem of estimating the spectral density of the normalized adjacency matrix of an $n$-node undirected graph. We provide a randomized algorithm that, with $O(n\epsilon^{-2})$ queries to a degree and neig…

Density Estimation