Safe-Bayesian Generalized Linear Regression
We study generalized Bayesian inference under misspecification, i.e. when the model is 'wrong but useful'. Generalized Bayes equips the likelihood with a learning rate $\eta$. We show that for generalized linear models (GLMs), $\eta$-generalized Bayes concentrates around the best approximation of the truth within the model for specific $\eta \neq 1$, even under severely misspecified noise, as long as the tails of the true distribution are exponential. We derive MCMC samplers for generalized Bayesian lasso and logistic regression and give examples of both simulated and real-world data in which generalized Bayes substantially outperforms standard Bayes.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bayesian linear regression with Student-t assumptions
As an automatic method of determining model complexity using the training data alone, Bayesian linear regression provides us a principled way to select hyperparameters. But one often needs approximation inference if dist…
regressionMachine Learning, Linear and Bayesian Models for Logistic Regression in Failure Detection Problems
In this work, we study the use of logistic regression in manufacturing failures detection. As a data set for the analysis, we used the data from Kaggle competition Bosch Production Line Performance. We considered the use…
BIG-bench Machine LearningGeneral ClassificationregressionDifferentially Private Bayesian Inference for Generalized Linear Models
Generalized linear models (GLMs) such as logistic regression are among the most widely used arms in data analyst's repertoire and often used on sensitive datasets. A large body of prior works that investigate GLMs under …
Bayesian InferenceregressionPosterior concentration and fast convergence rates for generalized Bayesian learning
In this paper, we study the learning rate of generalized Bayes estimators in a general setting where the hypothesis class can be uncountable and have an irregular shape, the loss function can have heavy tails, and the op…
regressionFBMS: An R Package for Flexible Bayesian Model Selection and Model Averaging
The FBMS R package facilitates Bayesian model selection and model averaging in complex regression settings by employing a variety of Monte Carlo model exploration methods. At its core, the package implements an efficient…