paper-with-me

Papers

Modelling Non-Smooth Signals with Complex Spectral Structure

2022-03-14 · Wessel P. Bruinsma, Martin Tegnér, Richard E. Turner

The Gaussian Process Convolution Model (GPCM; Tobar et al., 2015a) is a model for signals with complex spectral structure. A significant limitation of the GPCM is that it assumes a rapidly decaying spectrum: it can only model smooth signals. Moreover, inference in the GPCM currently requires (1) a mean-field assumption, resulting in poorly calibrated uncertainties, and (2) a tedious variational optimisation of large covariance matrices. We redesign the GPCM model to induce a richer distribution over the spectrum with relaxed assumptions about smoothness: the Causal Gaussian Process Convolution Model (CGPCM) introduces a causality assumption into the GPCM, and the Rough Gaussian Process Convolution Model (RGPCM) can be interpreted as a Bayesian nonparametric generalisation of the fractional Ornstein-Uhlenbeck process. We also propose a more effective variational inference scheme, going beyond the mean-field assumption: we design a Gibbs sampler which directly samples from the optimal variational solution, circumventing any variational optimisation entirely. The proposed variations of the GPCM are validated in experiments on synthetic and real-world data, showing promising results.

📄 PDF Abstract BibTeX arXiv:2203.06997

Code (3)

wesselb/gpcm 공식 구현 jax
beartype/plum jax
wesselb/plum jax

Tasks

Variational Inference

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Variational Inference 설명 없음

Similar Papers 제목 키워드 기반

Gaussian Processes for Music Audio Modelling and Content Analysis

2016-06-03 · Pablo A. Alvarado, Dan Stowell

Real music signals are highly variable, yet they have strong statistical structure. Prior information about the underlying physical mechanisms by which sounds are generated and rules by which complex sound structure is c…

Beat TrackingGaussian ProcessesMusic Transcription

Bayesian Formulations for Graph Spectral Denoising

2023-11-27 · Sam Leone, Xingzhi Sun, Michael Perlmutter, Smita Krishnaswamy

Here we consider the problem of denoising features associated to complex data, modeled as signals on a graph, via a smoothness prior. This is motivated in part by settings such as single-cell RNA where the data is very h…

Denoising

From Local to Global: Spectral-Inspired Graph Neural Networks

2022-09-24 · Ningyuan Huang, Soledad Villar, Carey E. Priebe, Da Zheng 외

Graph Neural Networks (GNNs) are powerful deep learning methods for Non-Euclidean data. Popular GNNs are message-passing algorithms (MPNNs) that aggregate and combine signals in a local graph neighborhood. However, shall…

Graph Embedding

Preserving Spectral Structure and Statistics in Diffusion Models

2025-12-19 · Baohua Yan, Jennifer Kava, Qingyuan Liu, Xuan Di arxiv

Standard diffusion models (DMs) rely on the total destruction of data into non-informative white noise, forcing the backward process to denoise from a fully unstructured noise state. While ensuring diversity, this result…

Image ReconstructionImage Generation

FUTON: Fourier Tensor Network for Implicit Neural Representations

2026-02-13 · Pooya Ashtari, Pourya Behmandpoor, Nikos Deligiannis, Aleksandra Pizurica arxiv

Implicit neural representations (INRs) have emerged as powerful tools for encoding signals, yet dominant MLP-based designs often suffer from slow convergence, overfitting to noise, and poor extrapolation. We introduce FU…

Image Denoising