paper-with-me

홈 › Papers

Dealing with Collinearity in Large-Scale Linear System Identification Using Gaussian Regression

2023-02-21 · Wenqi Cao, Gianluigi Pillonetto

Many problems arising in control require the determination of a mathematical model of the application. This has often to be performed starting from input-output data, leading to a task known as system identification in the engineering literature. One emerging topic in this field is estimation of networks consisting of several interconnected dynamic systems. We consider the linear setting assuming that system outputs are the result of many correlated inputs, hence making system identification severely ill-conditioned. This is a scenario often encountered when modeling complex cybernetics systems composed by many sub-units with feedback and algebraic loops. We develop a strategy cast in a Bayesian regularization framework where any impulse response is seen as realization of a zero-mean Gaussian process. Any covariance is defined by the so called stable spline kernel which includes information on smooth exponential decay. We design a novel Markov chain Monte Carlo scheme able to reconstruct the impulse responses posterior by efficiently dealing with collinearity. Our scheme relies on a variation of the Gibbs sampling technique: beyond considering blocks forming a partition of the parameter space, some other (overlapping) blocks are also updated on the basis of the level of collinearity of the system inputs. Theoretical properties of the algorithm are studied obtaining its convergence rate. Numerical experiments are included using systems containing hundreds of impulse responses and highly correlated inputs.

📄 PDF Abstract BibTeX arXiv:2302.10959

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Similar Papers 제목 키워드 기반

Dealing with collinearity in large-scale linear system identification using Bayesian regularization

2022-03-25 · Wenqi Cao, Gianluigi Pillonetto

We consider the identification of large-scale linear and stable dynamic systems whose outputs may be the result of many correlated inputs. Hence, severe ill-conditioning may affect the estimation problem. This is a scena…

Explainable Artificial Intelligence and Multicollinearity : A Mini Review of Current Approaches

2024-06-17 · Ahmed M Salih

Explainable Artificial Intelligence (XAI) methods help to understand the internal mechanism of machine learning models and how they reach a specific decision or made a specific action. The list of informative features is…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

On the Transfer of Collinearity to Computer Vision

2026-03-17 · Frederik Beuth, Danny Kowerko arxiv

Collinearity is a visual perception phenomenon in the human brain that amplifies spatially aligned edges arranged along a straight line. However, it is vague for which purpose humans might have this principle in the real…

A Probabilistic Model for Data Redundancy in the Feature Domain

2023-09-24 · Ghurumuruhan Ganesan

In this paper, we use a probabilistic model to estimate the number of uncorrelated features in a large dataset. Our model allows for both pairwise feature correlation (collinearity) and interdependency of multiple featur…

Feature Correlation

Hierarchical Clustering As a Novel Solution to the Notorious Multicollinearity Problem in Observational Causal Inference

2026-06-30 · Yufei Wu, Zhiying Gu, Alex Deng, Jacob Zhu 외 arxiv

Multicollinearity is a long lasting challenge in observational causal inference, especially in regressions -- highly correlated independent variables make it hard to isolate their individual impacts on outcomes of intere…

Causal Inference