paper-with-me

홈 › Papers

Spectral Sparsification of Random-Walk Matrix Polynomials

2015-02-12 · Dehua Cheng, Yu Cheng, Yan Liu, Richard Peng, Shang-Hua Teng

We consider a fundamental algorithmic question in spectral graph theory: Compute a spectral sparsifier of random-walk matrix-polynomial $$L_\alpha(G)=D-\sum_{r=1}^d\alpha_rD(D^{-1}A)^r$$ where $A$ is the adjacency matrix of a weighted, undirected graph, $D$ is the diagonal matrix of weighted degrees, and $\alpha=(\alpha_1...\alpha_d)$ are nonnegative coefficients with $\sum_{r=1}^d\alpha_r=1$. Recall that $D^{-1}A$ is the transition matrix of random walks on the graph. The sparsification of $L_\alpha(G)$ appears to be algorithmically challenging as the matrix power $(D^{-1}A)^r$ is defined by all paths of length $r$, whose precise calculation would be prohibitively expensive. In this paper, we develop the first nearly linear time algorithm for this sparsification problem: For any $G$ with $n$ vertices and $m$ edges, $d$ coefficients $\alpha$, and $\epsilon > 0$, our algorithm runs in time $O(d^2m\log^2n/\epsilon^{2})$ to construct a Laplacian matrix $\tilde{L}=D-\tilde{A}$ with $O(n\log n/\epsilon^{2})$ non-zeros such that $\tilde{L}\approx_{\epsilon}L_\alpha(G)$. Matrix polynomials arise in mathematical analysis of matrix functions as well as numerical solutions of matrix equations. Our work is particularly motivated by the algorithmic problems for speeding up the classic Newton's method in applications such as computing the inverse square-root of the precision matrix of a Gaussian random field, as well as computing the $q$th-root transition (for $q\geq1$) in a time-reversible Markov model. The key algorithmic step for both applications is the construction of a spectral sparsifier of a constant degree random-walk matrix-polynomials introduced by Newton's method. Our algorithm can also be used to build efficient data structures for effective resistances for multi-step time-reversible Markov models, and we anticipate that it could be useful for other tasks in network analysis.

📄 PDF Abstract BibTeX arXiv:1502.03496

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Spectral Sparsification and Regret Minimization Beyond Matrix Multiplicative Updates

2015-06-16 · Zeyuan Allen-Zhu, Zhenyu Liao, Lorenzo Orecchia

In this paper, we provide a novel construction of the linear-sized spectral sparsifiers of Batson, Spielman and Srivastava [BSS14]. While previous constructions required $\Omega(n^4)$ running time [BSS14, Zou12], our spa…

Sub-quadratic Algorithms for Kernel Matrices via Kernel Density Estimation

2022-12-01 · Ainesh Bakshi, Piotr Indyk, Praneeth Kacham, Sandeep Silwal 외

Kernel matrices, as well as weighted graphs represented by them, are ubiquitous objects in machine learning, statistics and other related fields. The main drawback of using kernel methods (learning and inference using ke…

Density Estimation

Faster Spectral Density Estimation and Sparsification in the Nuclear Norm

2024-06-11 · Yujia Jin, Ishani Karmarkar, Christopher Musco, Aaron Sidford 외

We consider the problem of estimating the spectral density of the normalized adjacency matrix of an $n$-node undirected graph. We provide a randomized algorithm that, with $O(n\epsilon^{-2})$ queries to a degree and neig…

Density Estimation

NetSMF: Large-Scale Network Embedding as Sparse Matrix Factorization

2019-06-26 · Jiezhong Qiu, Yuxiao Dong, Hao Ma, Jian Li 외

We study the problem of large-scale network embedding, which aims to learn latent representations for network mining applications. Previous research shows that 1) popular network embedding benchmarks, such as DeepWalk, a…

Network Embedding

SF-GRASS: Solver-Free Graph Spectral Sparsification

2020-08-17 · Ying Zhang, Zhiqiang Zhao, Zhuo Feng

Recent spectral graph sparsification techniques have shown promising performance in accelerating many numerical and graph algorithms, such as iterative methods for solving large sparse matrices, spectral partitioning of …

Representation Learning