paper-with-me

Papers

Subspace Constrained Variational Bayesian Inference for Structured Compressive Sensing with a Dynamic Grid

2024-07-24 · An Liu, Yufan Zhou, Wenkang Xu

We investigate the problem of recovering a structured sparse signal from a linear observation model with an uncertain dynamic grid in the sensing matrix. The state-of-the-art expectation maximization based compressed sensing (EM-CS) methods, such as turbo compressed sensing (Turbo-CS) and turbo variational Bayesian inference (Turbo-VBI), have a relatively slow convergence speed due to the double-loop iterations between the E-step and M-step. Moreover, each inner iteration in the E-step involves a high-dimensional matrix inverse in general, which is unacceptable for problems with large signal dimensions or real-time calculation requirements. Although there are some attempts to avoid the high-dimensional matrix inverse by majorization minimization, the convergence speed and accuracy are often sacrificed. To better address this problem, we propose an alternating estimation framework based on a novel subspace constrained VBI (SC-VBI) method, in which the high-dimensional matrix inverse is replaced by a low-dimensional subspace constrained matrix inverse (with the dimension equal to the sparsity level). We further prove the convergence of the SC-VBI to a stationary solution of the Kullback-Leibler divergence minimization problem. Simulations demonstrate that the proposed SC-VBI algorithm can achieve a much better tradeoff between complexity per iteration, convergence speed, and performance compared to the state-of-the-art algorithms.

📄 PDF Abstract BibTeX arXiv:2407.16947

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Inferencecompressed sensingCompressive Sensing

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Bilinear Subspace Variational Bayesian Inference for Joint Scattering Environment Sensing and Data Recovery in ISAC Systems

2025-02-02 · An Liu, Wenkang Xu, Wei Xu, Giuseppe Caire

This paper considers a joint scattering environment sensing and data recovery problem in an uplink integrated sensing and communication (ISAC) system. To facilitate joint scatterers localization and multi-user (MU) chann…

Bayesian InferenceIntegrated sensing and communicationISACPosition

Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference

2025-06-26 · Colin Samplawski, Adam D. Cobb, Manoj Acharya, Ramneet Kaur 외

Despite their widespread use, large language models (LLMs) are known to hallucinate incorrect information and be poorly calibrated. This makes the uncertainty quantification of these models of critical importance, especi…

Bayesian InferenceUncertainty QuantificationVariational Inference

Constrained Structure Learning for Scene Graph Generation

2022-01-27 · Daqi Liu, Miroslaw Bober, Josef Kittler

As a structured prediction task, scene graph generation aims to build a visually-grounded scene graph to explicitly model objects and their relationships in an input image. Currently, the mean field variational Bayesian …

Graph GenerationScene Graph GenerationStructured PredictionVariational Inference

Subspace Inference for Bayesian Deep Learning

2019-07-17 · Pavel Izmailov, Wesley J. Maddox, Polina Kirichenko, Timur Garipov 외

Bayesian inference was once a gold standard for learning with neural networks, providing accurate full predictive distributions and well calibrated uncertainty. However, scaling Bayesian inference techniques to deep neur…

Bayesian InferenceDeep Learningimage-classificationImage Classification+2

Bayesian Semi-structured Subspace Inference

2024-01-23 · Daniel Dold, David Rügamer, Beate Sick, Oliver Dürr

Semi-structured regression models enable the joint modeling of interpretable structured and complex unstructured feature effects. The structured model part is inspired by statistical models and can be used to infer the i…

regression