paper-with-me

홈 › Papers

Learning Laplacian Matrix in Smooth Graph Signal Representations

2014-06-30 · Xiaowen Dong, Dorina Thanou, Pascal Frossard, Pierre Vandergheynst

The construction of a meaningful graph plays a crucial role in the success of many graph-based representations and algorithms for handling structured data, especially in the emerging field of graph signal processing. However, a meaningful graph is not always readily available from the data, nor easy to define depending on the application domain. In particular, it is often desirable in graph signal processing applications that a graph is chosen such that the data admit certain regularity or smoothness on the graph. In this paper, we address the problem of learning graph Laplacians, which is equivalent to learning graph topologies, such that the input data form graph signals with smooth variations on the resulting topology. To this end, we adopt a factor analysis model for the graph signals and impose a Gaussian probabilistic prior on the latent variables that control these signals. We show that the Gaussian prior leads to an efficient representation that favors the smoothness property of the graph signals. We then propose an algorithm for learning graphs that enforces such property and is based on minimizing the variations of the signals on the learned graph. Experiments on both synthetic and real world data demonstrate that the proposed graph learning framework can efficiently infer meaningful graph topologies from signal observations under the smoothness prior.

📄 PDF Abstract BibTeX arXiv:1406.7842

Code (2)

Anou9531/Laplacian
ktran1/Leant_Laplacian

Tasks

Graph Learning

Similar Papers 제목 키워드 기반

Graph Laplacian Learning with Exponential Family Noise

2023-06-14 · Changhao Shi, Gal Mishne

Graph signal processing (GSP) is a prominent framework for analyzing signals on non-Euclidean domains. The graph Fourier transform (GFT) uses the combinatorial graph Laplacian matrix to reveal the spectral decomposition …

Analysis vs Synthesis - An Investigation of (Co)sparse Signal Models on Graphs

2018-11-11

In this work, we present a theoretical study of signals with sparse representations in the vertex domain of a graph, which is primarily motivated by the discrepancy arising from respectively adopting a synthesis and anal…

Laplacian Heads Improve Transformers by Smoothing Token Representations

2026-02-10 · Yuchong Zhang, Vardan Papyan arxiv

Transformers update token representations through multi-head attention and residual connections as $X \leftarrow X + \sum_{i} P^{(i)}XW_{V_i}W_{o_i}$, where $P^{(i)}$ is the softmax attention matrix in head $i$. We propo…

Self-Supervised Learning

Random Walk Graph Laplacian based Smoothness Prior for Soft Decoding of JPEG Images

2016-07-07 · Xianming Liu, Gene Cheung, Xiaolin Wu, Debin Zhao

Given the prevalence of JPEG compressed images, optimizing image reconstruction from the compressed format remains an important problem. Instead of simply reconstructing a pixel block from the centers of indexed DCT coef…

ClusteringImage ReconstructionQuantization

Manifold Graph Signal Restoration using Gradient Graph Laplacian Regularizer

2022-06-09 · Fei Chen, Gene Cheung, Xue Zhang

In the graph signal processing (GSP) literature, graph Laplacian regularizer (GLR) was used for signal restoration to promote piecewise smooth / constant reconstruction with respect to an underlying graph. However, for s…

Graph Embedding