paper-with-me

Papers

Total robustness in Bayesian Nonlinear Regression

2025-10-03 · Mengqi Chen, Charita Dellaporta, Thomas B. Berrett, Theodoros Damoulas arxiv

Modern regression analyses are often undermined by covariate measurement error, misspecification of the regression model, and misspecification of the measurement error distribution. We present, to the best of our knowledge, the first Bayesian nonparametric learning framework targeting total robustness to all three challenges in general nonlinear regression. Our framework places a joint Dirichlet process prior on the latent covariate--response distribution and updates it with posterior pseudo-samples of the latent covariates, so that inference is calibrated to the joint law. This yields estimators defined by minimizing the discrepancy between posterior realizations of the joint Dirichlet process and the model-implied joint distribution. We establish generalization bounds and provide a first proof of convergence and consistency of the resulting estimators under non-degenerate measurement error. A gradient-based implementation enables efficient computation; simulations and two real-data studies show improved stability to misspecification under increasing measurement error relative to recent Bayesian and frequentist alternatives.

📄 PDF Abstract BibTeX arXiv:2510.03131

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Stochastic tree ensembles for regularized nonlinear regression

2020-02-09 · Jingyu He, P. Richard Hahn

This paper develops a novel stochastic tree ensemble method for nonlinear regression, which we refer to as XBART, short for Accelerated Bayesian Additive Regression Trees. By combining regularization and stochastic searc…

regression

Permuted and Augmented Stick-Breaking Bayesian Multinomial Regression

2016-12-30 · Quan Zhang, Mingyuan Zhou

To model categorical response variables given their covariates, we propose a permuted and augmented stick-breaking (paSB) construction that one-to-one maps the observed categories to randomly permuted latent sticks. This…

regression

Nonlinear MCMC for Bayesian Machine Learning

2022-02-11 · James Vuckovic

We explore the application of a nonlinear MCMC technique first introduced in [1] to problems in Bayesian machine learning. We provide a convergence guarantee in total variation that uses novel results for long-time conve…

Bayesian Inference for Consistent Predictions in Overparameterized Nonlinear Regression

2024-04-06 · Tomoya Wakayama

The remarkable generalization performance of large-scale models has been challenging the conventional wisdom of the statistical learning theory. Although recent theoretical studies have shed light on this behavior in lin…

Bayesian InferenceLearning Theoryregression

Nonlinear Bayesian Update via Ensemble Kernel Regression with Clustering and Subsampling

2025-03-19 · Yoonsang Lee

Nonlinear Bayesian update for a prior ensemble is proposed to extend traditional ensemble Kalman filtering to settings characterized by non-Gaussian priors and nonlinear measurement operators. In this framework, the obse…

ClusteringDensity Estimationregression