Online Learning With Bayesian Classification Trees
Randomized classification trees are among the most popular machine learning tools and found successful applications in many areas. Although this classifier was originally designed as offline learning algorithm, there has been an increased interest in the last years to provide an online variant. In this paper, we propose an online learning algorithm for classification trees that adheres to Bayesian principles. In contrast to state-of-the-art approaches that produce large forests with complex trees, we aim at constructing small ensembles consisting of shallow trees with high generalization capabilities. Experiments on benchmark machine learning and body part recognition datasets show superior performance over state-of-the-art approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningClassificationGeneral ClassificationSimilar Papers 제목 키워드 기반
BET: Bayesian Ensemble Trees for Clustering and Prediction in Heterogeneous Data
We propose a novel "tree-averaging" model that utilizes the ensemble of classification and regression trees (CART). Each constituent tree is estimated with a subset of similar data. We treat this grouping of subsets as B…
ClassificationClusteringGeneral ClassificationregressionBayesian quantile additive regression trees
Ensemble of regression trees have become popular statistical tools for the estimation of conditional mean given a set of predictors. However, quantile regression trees and their ensembles have not yet garnered much atten…
Binary ClassificationGeneral Classificationquantile regressionregressionMPBART - Multinomial Probit Bayesian Additive Regression Trees
This article proposes Multinomial Probit Bayesian Additive Regression Trees (MPBART) as a multinomial probit extension of BART - Bayesian Additive Regression Trees (Chipman et al (2010)). MPBART is flexible to allow incl…
General ClassificationregressionType 2 Tobit Sample Selection Models with Bayesian Additive Regression Trees
This paper introduces Type 2 Tobit Bayesian Additive Regression Trees (TOBART-2). BART can produce accurate individual-specific treatment effect estimates. However, in practice estimates are often biased by sample select…
regressionVariational Boosted Soft Trees
Gradient boosting machines (GBMs) based on decision trees consistently demonstrate state-of-the-art results on regression and classification tasks with tabular data, often outperforming deep neural networks. However, the…
Decision MakingOut-of-Distribution Detectionregressiontabular-regression+1