SoftBart: Soft Bayesian Additive Regression Trees

2022-10-28 · Antonio R. Linero

Bayesian additive regression tree (BART) models have seen increased attention in recent years as a general-purpose nonparametric modeling technique. BART combines the flexibility of modern machine learning techniques with the principled uncertainty quantification of Bayesian inference, and it has been shown to be uniquely appropriate for addressing the high-noise problems that occur commonly in many areas of science, including medicine and the social sciences. This paper introduces the SoftBart package for fitting the Soft BART algorithm of Linero and Yang (2018). In addition to improving upon the predictive performance of other BART packages, a major goal of this package has been to facilitate the inclusion of BART in larger models, making it ideal for researchers in Bayesian statistics. I show both how to use this package for standard prediction tasks and how to embed BART models in larger models; I illustrate by using SoftBart to implement a nonparametric probit regression model, a semiparametric varying coefficient model, and a partial linear model.

📄 PDF Abstract BibTeX arXiv:2210.16375

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Inference regressionUncertainty Quantification

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Residual Connection 설명 없음

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

ASBART:Accelerated Soft Bayes Additive Regression Trees

2023-10-21 · Hao Ran, Yang Bai

Bayes additive regression trees(BART) is a nonparametric regression model which has gained wide-spread popularity in recent years due to its flexibility and high accuracy of estimation. Soft BART,one variation of BART,im…

regression

Type 2 Tobit Sample Selection Models with Bayesian Additive Regression Trees

2025-02-05 · Eoghan O'Neill

This paper introduces Type 2 Tobit Bayesian Additive Regression Trees (TOBART-2). BART can produce accurate individual-specific treatment effect estimates. However, in practice estimates are often biased by sample select…

regression

BAST: Bayesian Additive Regression Spanning Trees for Complex Constrained Domain

2021-12-01 · NeurIPS 2021 12 · Zhao Tang Luo, Huiyan Sang, Bani Mallick

Nonparametric regression on complex domains has been a challenging task as most existing methods, such as ensemble models based on binary decision trees, are not designed to account for intrinsic geometries and domain bo…

Bayesian Inference regression

MPBART - Multinomial Probit Bayesian Additive Regression Trees

2013-09-30 · Bereket P. Kindo, Hao Wang, Edsel A. Peña

This article proposes Multinomial Probit Bayesian Additive Regression Trees (MPBART) as a multinomial probit extension of BART - Bayesian Additive Regression Trees (Chipman et al (2010)). MPBART is flexible to allow incl…

General Classification regression

Bayesian quantile additive regression trees

2016-07-10 · Bereket P. Kindo, Hao Wang, Timothy Hanson, Edsel A. Peña

Ensemble of regression trees have become popular statistical tools for the estimation of conditional mean given a set of predictors. However, quantile regression trees and their ensembles have not yet garnered much atten…

Binary Classification General Classification quantile regression regression