paper-with-me

Papers

Incremental Spectral Sparsification for Large-Scale Graph-Based Semi-Supervised Learning

2016-01-21 · Daniele Calandriello, Alessandro Lazaric, Michal Valko, Ioannis Koutis

While the harmonic function solution performs well in many semi-supervised learning (SSL) tasks, it is known to scale poorly with the number of samples. Recent successful and scalable methods, such as the eigenfunction method focus on efficiently approximating the whole spectrum of the graph Laplacian constructed from the data. This is in contrast to various subsampling and quantization methods proposed in the past, which may fail in preserving the graph spectra. However, the impact of the approximation of the spectrum on the final generalization error is either unknown, or requires strong assumptions on the data. In this paper, we introduce Sparse-HFS, an efficient edge-sparsification algorithm for SSL. By constructing an edge-sparse and spectrally similar graph, we are able to leverage the approximation guarantees of spectral sparsification methods to bound the generalization error of Sparse-HFS. As a result, we obtain a theoretically-grounded approximation scheme for graph-based SSL that also empirically matches the performance of known large-scale methods.

📄 PDF Abstract BibTeX arXiv:1601.05675

Code (0)

등록된 구현이 없습니다.

Tasks

Quantization

Similar Papers 제목 키워드 기반

inGRASS: Incremental Graph Spectral Sparsification via Low-Resistance-Diameter Decomposition

2024-02-26 · Ali Aghdaei, Zhuo Feng

This work presents inGRASS, a novel algorithm designed for incremental spectral sparsification of large undirected graphs. The proposed inGRASS algorithm is highly scalable and parallel-friendly, having a nearly-linear t…

Analysis of Kelner and Levin graph sparsification algorithm for a streaming setting

2016-09-13 · Daniele Calandriello, Alessandro Lazaric, Michal Valko

We derive a new proof to show that the incremental resparsification algorithm proposed by Kelner and Levin (2013) produces a spectral sparsifier in high probability. We rigorously take into account the dependencies acros…

SF-GRASS: Solver-Free Graph Spectral Sparsification

2020-08-17 · Ying Zhang, Zhiqiang Zhao, Zhuo Feng

Recent spectral graph sparsification techniques have shown promising performance in accelerating many numerical and graph algorithms, such as iterative methods for solving large sparse matrices, spectral partitioning of …

Representation Learning

A Unified Spectral Sparsification Framework for Directed Graphs

2021-01-01 · Ying Zhang, Zhiqiang Zhao, Zhuo Feng

Recent spectral graph sparsification research allows constructing nearly-linear-sized subgraphs that can well preserve the spectral (structural) properties of the original graph, such as the first few eigenvalues and eig…

Towards Scalable Spectral Clustering via Spectrum-Preserving Sparsification

2017-10-12 · Yongyu Wang, Zhuo Feng

The eigendeomposition of nearest-neighbor (NN) graph Laplacian matrices is the main computational bottleneck in spectral clustering. In this work, we introduce a highly-scalable, spectrum-preserving graph sparsification …

Clustering