paper-with-me

홈 › Papers

Importance of spatial predictor variable selection in machine learning applications -- Moving from data reproduction to spatial prediction

2019-08-21 · Hanna Meyer, Christoph Reudenbach, Stephan Wöllauer, Thomas Nauss

Machine learning algorithms find frequent application in spatial prediction of biotic and abiotic environmental variables. However, the characteristics of spatial data, especially spatial autocorrelation, are widely ignored. We hypothesize that this is problematic and results in models that can reproduce training data but are unable to make spatial predictions beyond the locations of the training samples. We assume that not only spatial validation strategies but also spatial variable selection is essential for reliable spatial predictions. We introduce two case studies that use remote sensing to predict land cover and the leaf area index for the "Marburg Open Forest", an open research and education site of Marburg University, Germany. We use the machine learning algorithm Random Forests to train models using non-spatial and spatial cross-validation strategies to understand how spatial variable selection affects the predictions. Our findings confirm that spatial cross-validation is essential in preventing overoptimistic model performance. We further show that highly autocorrelated predictors (such as geolocation variables, e.g. latitude, longitude) can lead to considerable overfitting and result in models that can reproduce the training data but fail in making spatial predictions. The problem becomes apparent in the visual assessment of the spatial predictions that show clear artefacts that can be traced back to a misinterpretation of the spatially autocorrelated predictors by the algorithm. Spatial variable selection could automatically detect and remove such variables that lead to overfitting, resulting in reliable spatial prediction patterns and improved statistical spatial model performance. We conclude that in addition to spatial validation, a spatial variable selection must be considered in spatial predictions of ecological data to produce reliable predictions.

📄 PDF Abstract BibTeX arXiv:1908.07805

Code (1)

HannaMeyer/EcoMod_SpML 공식 구현

Tasks

Variable Selection

Similar Papers 제목 키워드 기반

Variable Selection Using Relative Importance Rankings

2025-09-13 · Tien-En Chang, Argon Chen arxiv

Although conceptually related, variable selection and relative importance (RI) analysis have been treated quite differently in the literature. While RI is typically used for post-hoc model explanation, this paper explore…

Computational Efficiency

How Your Location Relates to Health: Variable Importance and Interpretable Machine Learning for Environmental and Sociodemographic Data

2025-01-03 · Ishaan Maitra, Raymond Lin, Eric Chen, Jon Donnelly 외

Health outcomes depend on complex environmental and sociodemographic factors whose effects change over location and time. Only recently has fine-grained spatial and temporal data become available to study these effects, …

Additive modelsInterpretable Machine Learning

A novel interpretable machine learning system to generate clinical risk scores: An application for predicting early mortality or unplanned readmission in a retrospective cohort study

2022-01-10 · Yilin Ning, Siqi Li, Marcus Eng Hock Ong, Feng Xie 외

Risk scores are widely used for clinical decision making and commonly generated from logistic regression models. Machine-learning-based methods may work well for identifying important predictors, but such 'black box' var…

BIG-bench Machine LearningDecision MakingInterpretable Machine LearningVariable Selection

A Generalized Variable Importance Metric and Estimator for Black Box Machine Learning Models

2022-12-20 · Mohammad Kaviul Anam Khan, Olli Saarela, Rafal Kustra

In this paper we define a population parameter, ``Generalized Variable Importance Metric (GVIM)'', to measure importance of predictors for black box machine learning methods, where the importance is not represented by mo…

Marginal and Conditional Importance Measures from Machine Learning Models and Their Relationship with Conditional Average Treatment Effect

2025-01-28 · Mohammad Kaviul Anam Khan, Olli Saarela, Rafal Kustra

Interpreting black-box machine learning models is challenging due to their strong dependence on data and inherently non-parametric nature. This paper reintroduces the concept of importance through "Marginal Variable Impo…