paper-with-me

Papers

Variational Learning ISTA

2024-07-09 · Fabio Valerio Massoli, Christos Louizos, Arash Behboodi

Compressed sensing combines the power of convex optimization techniques with a sparsity-inducing prior on the signal space to solve an underdetermined system of equations. For many problems, the sparsifying dictionary is not directly given, nor its existence can be assumed. Besides, the sensing matrix can change across different scenarios. Addressing these issues requires solving a sparse representation learning problem, namely dictionary learning, taking into account the epistemic uncertainty of the learned dictionaries and, finally, jointly learning sparse representations and reconstructions under varying sensing matrix conditions. We address both concerns by proposing a variant of the LISTA architecture. First, we introduce Augmented Dictionary Learning ISTA (A-DLISTA), which incorporates an augmentation module to adapt parameters to the current measurement setup. Then, we propose to learn a distribution over dictionaries via a variational approach, dubbed Variational Learning ISTA (VLISTA). VLISTA exploits A-DLISTA as the likelihood model and approximates a posterior distribution over the dictionaries as part of an unfolded LISTA-based recovery algorithm. As a result, VLISTA provides a probabilistic way to jointly learn the dictionary distribution and the reconstruction algorithm with varying sensing matrices. We provide theoretical and experimental support for our architecture and show that our model learns calibrated uncertainties.

📄 PDF Abstract BibTeX arXiv:2407.06646

Code (0)

등록된 구현이 없습니다.

Tasks

compressed sensingDictionary LearningRepresentation Learning

Similar Papers 제목 키워드 기반

Radon Sobolev Variational Auto-Encoders

2019-11-29 · Gabriel Turinici

The quality of generative models (such as Generative adversarial networks and Variational Auto-Encoders) depends heavily on the choice of a good probability distance. However some popular metrics like the Wasserstein or …

SDFs from Unoriented Point Clouds using Neural Variational Heat Distances

2025-04-15 · Samuel Weidemaier, Florine Hartwig, Josua Sassen, Sergio Conti 외

We propose a novel variational approach for computing neural Signed Distance Fields (SDF) from unoriented point clouds. To this end, we replace the commonly used eikonal equation with the heat method, carrying over to th…

Surface Reconstruction

Sliced Wasserstein Variational Inference

2022-07-26 · pproximateinference AABI Symposium 2022 2 · Mingxuan Yi, Song Liu

Variational Inference approximates an unnormalized distribution via the minimization of Kullback-Leibler (KL) divergence. Although this divergence is efficient for computation and has been widely used in applications, it…

validVariational Inference

Variational Inference for Mahalanobis Distance Metrics in Gaussian Process Regression

2013-12-01 · NeurIPS 2013 12 · Michalis Titsias Rc Aueb, Miguel Lazaro-Gredilla

We introduce a novel variational method that allows to approximately integrate out kernel hyperparameters, such as length-scales, in Gaussian process regression. This approach consists of a novel variant of the variation…

regressionVariational Inference

Variational Regularization in Inverse Problems and Machine Learning

2021-12-08 · Martin Burger

This paper discusses basic results and recent developments on variational regularization methods, as developed for inverse problems. In a typical setup we review basic properties needed to obtain a convergent regularizat…

BIG-bench Machine Learning