paper-with-me

Papers

Online Multi-target regression trees with stacked leaf models

2019-03-29 · Saulo Martiello Mastelini, Sylvio Barbon Jr., André Carlos Ponce de Leon Ferreira de Carvalho

One of the current challenges in machine learning is how to deal with data coming at increasing rates in data streams. New predictive learning strategies are needed to cope with the high throughput data and concept drift. One of the data stream mining tasks where new learning strategies are needed is multi-target regression, due to its applicability in a high number of real world problems. While reliable and effective learning strategies have been proposed for batch multi-target regression, few have been proposed for multi-target online learning in data streams. Besides, most of the existing solutions do not consider the occurrence of inter-target correlations when making predictions. In this work, we propose a novel online learning strategy for multi-target regression in data streams. The proposed strategy extends existing online decision tree learning algorithm to explore inter-target dependencies while making predictions. For such, the proposed strategy, called Stacked Single-target Hoeffding Tree (SST-HT), uses the inter-target dependencies as an additional information source to enhance predictive accuracy. Throughout an extensive experimental setup, we evaluate our proposal against state-of-the-art decision tree-based algorithms for online multi-target regression. According to the experimental results, SST-HT presents superior predictive accuracy, with a small increase in the processing time and memory requirements.

📄 PDF Abstract BibTeX arXiv:1903.12483

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-target regressionNeural Network Compressionregression

Similar Papers 제목 키워드 기반

pystacked: Stacking generalization and machine learning in Stata

2022-08-23 · Achim Ahrens, Christian B. Hansen, Mark E. Schaffer

pystacked implements stacked generalization (Wolpert, 1992) for regression and binary classification via Python's scikit-learn. Stacking combines multiple supervised machine learners -- the "base" or "level-0" learners -…

Binary Classificationregression

Memory-Efficient Global Refinement of Decision-Tree Ensembles and its Application to Face Alignment

2017-02-27 · Nenad Markuš, Ivan Gogić, Igor S. Pandžić, Jörgen Ahlberg

Ren et al. recently introduced a method for aggregating multiple decision trees into a strong predictor by interpreting a path taken by a sample down each tree as a binary vector and performing linear regression on top o…

Face AlignmentQuantizationregression

Softplus Regressions and Convex Polytopes

2016-08-23 · Mingyuan Zhou

To construct flexible nonlinear predictive distributions, the paper introduces a family of softplus function based regression models that convolve, stack, or combine both operations by convolving countably infinite stack…

Bayesian InferenceData Augmentationregression

BooST: Boosting Smooth Trees for Partial Effect Estimation in Nonlinear Regressions

2018-08-10 · Yuri Fonseca, Marcelo Medeiros, Gabriel Vasconcelos, Alvaro Veiga

In this paper, we introduce a new machine learning (ML) model for nonlinear regression called the Boosted Smooth Transition Regression Trees (BooST), which is a combination of boosting algorithms with smooth transition r…

BIG-bench Machine Learningregression

A Meta-learning based Stacked Regression Approach for Customer Lifetime Value Prediction

2023-08-07 · Karan Gadgil, Sukhpal Singh Gill, Ahmed M. Abdelmoniem

Companies across the globe are keen on targeting potential high-value customers in an attempt to expand revenue and this could be achieved only by understanding the customers more. Customer Lifetime Value (CLV) is the to…

Meta-LearningregressionValue prediction