paper-with-me

홈 › Papers

Variational Bayesian Filtering with Subspace Information for Extreme Spatio-Temporal Matrix Completion

2022-01-20 · Charul Paliwal, Pravesh Biyani, Ketan Rajawat

Missing data is a common problem in real-world sensor data collection. The performance of various approaches to impute data degrade rapidly in the extreme scenarios of low data sampling and noisy sampling, a case present in many real-world problems in the field of traffic sensing and environment monitoring, etc. However, jointly exploiting the spatiotemporal and periodic structure, which is generally not captured by classical matrix completion approaches, can improve the imputation performance of sensor data in such real-world conditions. We present a Bayesian approach towards spatiotemporal matrix completion wherein we estimate the underlying temporarily varying subspace using a Variational Bayesian technique. We jointly couple the low-rank matrix completion with the state space autoregressive framework along with a penalty function on the slowly varying subspace to model the temporal and periodic evolution in the data. A major advantage of our method is that a critical parameter like the rank of the model is automatically tuned using the automatic relevance determination (ARD) approach, unlike most matrix/tensor completion techniques. We also propose a robust version of the above formulation, which improves the performance of imputation in the presence of outliers. We evaluate the proposed Variational Bayesian Filtering with Subspace Information (VBFSI) method to impute matrices in real-world traffic and air pollution data. Simulation results demonstrate that the proposed method outperforms the recent state-of-the-art methods and provides a sufficiently accurate imputation for different sampling rates. In particular, we demonstrate that fusing the subspace evolution over days can improve the imputation performance with even 15% of the data sampling.

📄 PDF Abstract BibTeX arXiv:2201.08307

Code (0)

등록된 구현이 없습니다.

Tasks

ImputationLow-Rank Matrix CompletionMatrix Completion

Similar Papers 제목 키워드 기반

Online Variational Bayesian Subspace Filtering with Applications

2019-06-24

Matrix completion and robust principal component analysis have been widely used for the recovery of data suffering from missing entries or outliers. In many real-world applications however, the data is also time-varying,…

ImputationMatrix Completion

Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference

2025-06-26 · Colin Samplawski, Adam D. Cobb, Manoj Acharya, Ramneet Kaur 외

Despite their widespread use, large language models (LLMs) are known to hallucinate incorrect information and be poorly calibrated. This makes the uncertainty quantification of these models of critical importance, especi…

Bayesian InferenceUncertainty QuantificationVariational Inference

Concentration of tempered posteriors and of their variational approximations

2017-06-28 · Pierre Alquier, James Ridgway

While Bayesian methods are extremely popular in statistics and machine learning, their application to massive datasets is often challenging, when possible at all. Indeed, the classical MCMC algorithms are prohibitively s…

Collaborative FilteringMatrix Completion

Supervised Dictionary Learning by a Variational Bayesian Group Sparse Nonnegative Matrix Factorization

2014-05-27 · Ivan Ivek

Nonnegative matrix factorization (NMF) with group sparsity constraints is formulated as a probabilistic graphical model and, assuming some observed data have been generated by the model, a feasible variational Bayesian a…

ClassificationDictionary LearningFace RecognitionFacial Expression Recognition+2

Global Solver and Its Efficient Approximation for Variational Bayesian Low-rank Subspace Clustering

2013-12-01 · NeurIPS 2013 12 · Shinichi Nakajima, Akiko Takeda, S. Derin Babacan, Masashi Sugiyama 외

When a probabilistic model and its prior are given, Bayesian learning offers inference with automatic parameter tuning. However, Bayesian learning is often obstructed by computational difficulty: the rigorous Bayesian l…

ClusteringComputational Efficiency