paper-with-me

홈 › Papers

Variable importance measure for spatial machine learning models with application to air pollution exposure prediction

2024-06-04 · Si Cheng, Magali N. Blanco, Lianne Sheppard, Ali Shojaie, Adam Szpiro

Exposure assessment is fundamental to air pollution cohort studies. The objective is to predict air pollution exposures for study subjects at locations without data in order to optimize our ability to learn about health effects of air pollution. In addition to generating accurate predictions to minimize exposure measurement error, understanding the mechanism captured by the model is another crucial aspect that may not always be straightforward due to the complex nature of machine learning methods, as well as the lack of unifying notions of variable importance. This is further complicated in air pollution modeling by the presence of spatial correlation. We tackle these challenges in two datasets: sulfur (S) from regulatory United States national PM2.5 sub-species data and ultrafine particles (UFP) from a new Seattle-area traffic-related air pollution dataset. Our key contribution is a leave-one-out approach for variable importance that leads to interpretable and comparable measures for a broad class of models with separable mean and covariance components. We illustrate our approach with several spatial machine learning models, and it clearly highlights the difference in model mechanisms, even for those producing similar predictions. We leverage insights from this variable importance measure to assess the relative utilities of two exposure models for S and UFP that have similar out-of-sample prediction accuracies but appear to draw on different types of spatial information to make predictions.

📄 PDF Abstract BibTeX arXiv:2406.01982

Code (0)

등록된 구현이 없습니다.

Tasks

Error Understanding

Similar Papers 제목 키워드 기반

Measuring Variable Importance in Heterogeneous Treatment Effects with Confidence

2024-08-23 · Joseph Paillard, Angel Reyero Lobo, Vitaliy Kolodyazhniy, Bertrand Thirion 외

Causal machine learning holds promise for estimating individual treatment effects from complex data. For successful real-world applications of machine learning methods, it is of paramount importance to obtain reliable in…

Causal Inference

Importance of spatial predictor variable selection in machine learning applications -- Moving from data reproduction to spatial prediction

2019-08-21 · Hanna Meyer, Christoph Reudenbach, Stephan Wöllauer, Thomas Nauss

Machine learning algorithms find frequent application in spatial prediction of biotic and abiotic environmental variables. However, the characteristics of spatial data, especially spatial autocorrelation, are widely igno…

Variable Selection

Hierarchical Variable Importance with Statistical Control for Medical Data-Based Prediction

2025-08-12 · Joseph Paillard, Antoine Collas, Denis A. Engemann, Bertrand Thirion arxiv

Recent advances in machine learning have greatly expanded the repertoire of predictive methods for medical imaging. However, the interpretability of complex models remains a challenge, which limits their utility in medic…

A Generalized Variable Importance Metric and Estimator for Black Box Machine Learning Models

2022-12-20 · Mohammad Kaviul Anam Khan, Olli Saarela, Rafal Kustra

In this paper we define a population parameter, ``Generalized Variable Importance Metric (GVIM)'', to measure importance of predictors for black box machine learning methods, where the importance is not represented by mo…

Challenges in Variable Importance Ranking Under Correlation

2024-02-05 · Annie Liang, Thomas Jemielita, Andy Liaw, Vladimir Svetnik 외

Variable importance plays a pivotal role in interpretable machine learning as it helps measure the impact of factors on the output of the prediction model. Model agnostic methods based on the generation of "null" feature…

Feature CorrelationInterpretable Machine Learning