paper-with-me

홈 › Papers

Shrinkage priors for Bayesian Substitute Confounders

2026-06-16 · Yordan P. Raykov, Hengrui Luo, Justin D. Strait, Wasiur R. KhudaBukhsh arxiv

Multi-cause observational studies contain information about unmeasured confounding through the dependence structure among causes. However, literal imputation of the unobserved confounder is often more complex than learning a lower-dimensional substitute score that preserves the shared assignment variation needed for stable causal adjustment. The deconfounder (Wang and Blei, 2019) and related substitute confounder methods exploit this idea, but flexible assignment models can fit the joint distribution of the causes while producing scores that over-encode the treatment vector, collapse overlap, or capture single-cause variation. We develop a Bayesian factor assignment framework for learning sparse substitute confounders that retain coarse multi-cause dependence with shrinkage priors. The theory is stated at the level of posterior concentration, factor score contraction, and overlap-preserving assignment geometry and therefore does not rely on a particular shrinkage prior. Under these conditions, the proposed regression-adjusted estimators are consistent for mean potential outcomes when the corresponding latent variable identification assumptions hold. Shrinkage priors provide a natural tool for latent structural learning: they favour low-dimensional factors supported by multiple causes, discourage effectively single-cause factors, and induce an ordering of the latent factors through progressive shrinkage. Synthetic experiments illustrate the roles of signal strength, outcome validity, and geometry-aware regularization. In an Alzheimer's Disease Neuroimaging Initiative (ADNI) baseline analysis, sparse substitute scores recover much of the adjustment obtained by directly conditioning on invasive cerebrospinal-fluid biomarkers, while collapse diagnostics identify when fitted factors reduce to individual observed measurements.

📄 PDF Abstract BibTeX arXiv:2606.18535

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Generalized Cumulative Shrinkage Process Priors with Applications to Sparse Bayesian Factor Analysis

2023-03-01 · Sylvia Frühwirth-Schnatter

The paper discusses shrinkage priors which impose increasing shrinkage in a sequence of parameters. We review the cumulative shrinkage process (CUSP) prior of Legramanti et al. (2020), which is a spike-and-slab shrinkage…

Forecasting macroeconomic data with Bayesian VARs: Sparse or dense? It depends!

2022-06-10 · Luis Gruber, Gregor Kastner

Vector autogressions (VARs) are widely applied when it comes to modeling and forecasting macroeconomic variables. In high dimensions, however, they are prone to overfitting. Bayesian methods, more concretely shrinkage pr…

Variable Selection

Flexible shrinkage in high-dimensional Bayesian spatial autoregressive models

2018-05-28

This article introduces two absolutely continuous global-local shrinkage priors to enable stochastic variable selection in the context of high-dimensional matrix exponential spatial specifications. Existing approaches as…

Variable SelectionVocal Bursts Intensity Prediction

Bayesian sparse convex clustering via global-local shrinkage priors

2019-11-20 · Kaito Shimamura, Shuichi. Kawano

Sparse convex clustering is to cluster observations and conduct variable selection simultaneously in the framework of convex clustering. Although a weighted $L_1$ norm is usually employed for the regularization term in s…

ClusteringVariable Selection

Dirichlet Scale Mixture Priors for Bayesian Neural Networks

2026-02-23 · August Arnstad, Leiv Rønneberg, Geir Storvik arxiv

Neural networks are the cornerstone of modern machine learning, yet can be difficult to interpret, give overconfident predictions and are vulnerable to adversarial attacks. Bayesian neural networks (BNNs) provide some al…