paper-with-me

홈 › Papers

Using Empirical Covariance Matrix in Enhancing Prediction Accuracy of Linear Models with Missing Information

2016-11-21 · Ahmadreza Moradipari, Sina Shahsavari, Ashkan Esmaeili, Farokh Marvasti

Inference and Estimation in Missing Information (MI) scenarios are important topics in Statistical Learning Theory and Machine Learning (ML). In ML literature, attempts have been made to enhance prediction through precise feature selection methods. In sparse linear models, LASSO is well-known in extracting the desired support of the signal and resisting against noisy systems. When sparse models are also suffering from MI, the sparse recovery and inference of the missing models are taken into account simultaneously. In this paper, we will introduce an approach which enjoys sparse regression and covariance matrix estimation to improve matrix completion accuracy, and as a result enhancing feature selection preciseness which leads to reduction in prediction Mean Squared Error (MSE). We will compare the effect of employing covariance matrix in enhancing estimation accuracy to the case it is not used in feature selection. Simulations show the improvement in the performance as compared to the case where the covariance matrix estimation is not used.

📄 PDF Abstract BibTeX arXiv:1611.07093

Code (0)

등록된 구현이 없습니다.

Tasks

feature selectionLearning TheoryMatrix Completion

Similar Papers 제목 키워드 기반

Matrix Sketching in Bandits: Current Pitfalls and New Framework

2024-10-14 · Dongxie Wen, Hanyan Yin, Xiao Zhang, Zhewei Wei

The utilization of sketching techniques has progressively emerged as a pivotal method for enhancing the efficiency of online learning. In linear bandit settings, current sketch-based approaches leverage matrix sketching …

Optimization of loading factor preventing target cancellation

2020-10-09 · Boris N. Oreshkin, Peter A. Bakulev

Adaptive algorithms based on sample matrix inversion belong to an important class of algorithms used in radar target detection to overcome prior uncertainty of interference covariance. Sample matrix inversion problem is …

Convex Banding of the Covariance Matrix

2014-05-23 · Jacob Bien, Florentina Bunea, Luo Xiao

We introduce a new sparse estimator of the covariance matrix for high-dimensional models in which the variables have a known ordering. Our estimator, which is the solution to a convex optimization problem, is equivalentl…

Gaussian Process-based learning with new MCMC-based implementation of Wishart prior on correlation matrix

2026-05-26 · Kane Warrior, Dalia Chakrabarty arxiv

In probabilstic supervised learning of an input-output relationship - as a sample function of a Gaussian Process (GP) - priors are typically specified for the hyperparameters of the kernel that parametrises the covarianc…

Bayesian Inference

Bridging Fairness Gaps: A (Conditional) Distance Covariance Perspective in Fairness Learning

2024-12-01 · Ruifan Huang, Haixia Liu

We bridge fairness gaps from a statistical perspective by selectively utilizing either conditional distance covariance or distance covariance statistics as measures to assess the independence between predictions and sens…

Computational EfficiencyFairness