paper-with-me

홈 › Papers

Gradient Boosting for Spatial Regression Models with Autoregressive Disturbances

2025-06-16 · Michael Balzer

Researchers in urban and regional studies increasingly deal with spatial data that reflects geographic location and spatial relationships. As a framework for dealing with the unique nature of spatial data, various spatial regression models have been introduced. In this article, a novel model-based gradient boosting algorithm for spatial regression models with autoregressive disturbances is proposed. Due to the modular nature, the approach provides an alternative estimation procedure which is feasible even in high-dimensional settings where established quasi-maximum likelihood or generalized method of moments estimators do not yield unique solutions. The approach additionally enables data-driven variable and model selection in low- as well as high-dimensional settings. Since the bias-variance trade-off is also controlled in the algorithm, implicit regularization is imposed which improves prediction accuracy on out-of-sample spatial data. Detailed simulation studies regarding the performance of estimation, prediction and variable selection in low- and high-dimensional settings confirm proper functionality of the proposed methodology. To illustrative the functionality of the model-based gradient boosting algorithm, a case study is presented where the life expectancy in German districts is modeled incorporating a potential spatial dependence structure.

📄 PDF Abstract BibTeX arXiv:2506.13682

Code (0)

등록된 구현이 없습니다.

Tasks

Model SelectionregressionVariable Selection

Similar Papers 제목 키워드 기반

GWRBoost:A geographically weighted gradient boosting method for explainable quantification of spatially-varying relationships

2022-12-12 · Han Wang, Zhou Huang, Ganmin Yin, Yi Bao 외

The geographically weighted regression (GWR) is an essential tool for estimating the spatial variation of relationships between dependent and independent variables in geographical contexts. However, GWR suffers from the …

parameter estimationregression

Stagewise Boosting Distributional Regression

2024-05-28 · Mattias Wetscher, Johannes Seiler, Reto Stauffer, Nikolaus Umlauf

Forward stagewise regression is a simple algorithm that can be used to estimate regularized models. The updating rule adds a small constant to a regression coefficient in each iteration, such that the underlying optimiza…

regression

Gradient boosting machine with partially randomized decision trees

2020-06-19 · Andrei V. Konstantinov, Lev V. Utkin

The gradient boosting machine is a powerful ensemble-based machine learning method for solving regression problems. However, one of the difficulties of its using is a possible discontinuity of the regression function, wh…

BIG-bench Machine Learningregression

NGBoost: Natural Gradient Boosting for Probabilistic Prediction

2019-10-08 · ICML 2020 1 · Tony Duan, Anand Avati, Daisy Yi Ding, Khanh K. Thai 외

We present Natural Gradient Boosting (NGBoost), an algorithm for generic probabilistic prediction via gradient boosting. Typical regression models return a point estimate, conditional on covariates, but probabilistic reg…

Predictionregressionscoring ruleWeather Forecasting

A Generalized Stacking for Implementing Ensembles of Gradient Boosting Machines

2020-10-12 · Andrei V. Konstantinov, Lev V. Utkin

The gradient boosting machine is one of the powerful tools for solving regression problems. In order to cope with its shortcomings, an approach for constructing ensembles of gradient boosting models is proposed. The main…

regression