paper-with-me

홈 › Papers

Demystifying Functional Random Forests: Novel Explainability Tools for Model Transparency in High-Dimensional Spaces

2024-08-22 · Fabrizio Maturo, Annamaria Porreca

The advent of big data has raised significant challenges in analysing high-dimensional datasets across various domains such as medicine, ecology, and economics. Functional Data Analysis (FDA) has proven to be a robust framework for addressing these challenges, enabling the transformation of high-dimensional data into functional forms that capture intricate temporal and spatial patterns. However, despite advancements in functional classification methods and very high performance demonstrated by combining FDA and ensemble methods, a critical gap persists in the literature concerning the transparency and interpretability of black-box models, e.g. Functional Random Forests (FRF). In response to this need, this paper introduces a novel suite of explainability tools to illuminate the inner mechanisms of FRF. We propose using Functional Partial Dependence Plots (FPDPs), Functional Principal Component (FPC) Probability Heatmaps, various model-specific and model-agnostic FPCs' importance metrics, and the FPC Internal-External Importance and Explained Variance Bubble Plot. These tools collectively enhance the transparency of FRF models by providing a detailed analysis of how individual FPCs contribute to model predictions. By applying these methods to an ECG dataset, we demonstrate the effectiveness of these tools in revealing critical patterns and improving the explainability of FRF.

📄 PDF Abstract BibTeX arXiv:2408.12288

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Enhancing Visual Interpretability and Explainability in Functional Survival Trees and Forests

2025-04-25 · Giuseppe Loffredo, Elvira Romano, Fabrizio Maturo

Functional survival models are key tools for analyzing time-to-event data with complex predictors, such as functional or high-dimensional inputs. Despite their predictive strength, these models often lack interpretabilit…

Decision Making

Randomized Spline Trees for Functional Data Classification: Theory and Application to Environmental Time Series

2024-09-12 · Donato Riccio, Fabrizio Maturo, Elvira Romano

Functional data analysis (FDA) and ensemble learning can be powerful tools for analyzing complex environmental time series. Recent literature has highlighted the key role of diversity in enhancing accuracy and reducing v…

DiversityEnsemble LearningTime SeriesTime Series Analysis+1

Signed iterative random forests to identify enhancer-associated transcription factor binding

2018-10-16 · Karl Kumbier, Sumanta Basu, Erwin Frise, Susan E. Celniker 외

Standard ChIP-seq peak calling pipelines seek to differentiate biochemically reproducible signals of individual genomic elements from background noise. However, reproducibility alone does not imply functional regulation …

Interpretable Machine Learning

Molecular Insights from Conformational Ensembles via Machine Learning

2020-02-04 · Biophys Journal 2020 2 · Fleetwood O, Kasimova MA, Westerlund AM, Delemotte L

Biomolecular simulations are intrinsically high dimensional and generate noisy data sets of ever-increasing size. Extracting important features from the data is crucial for understanding the biophysical properties of mol…

BIG-bench Machine LearningDimensionality ReductionPhysical Simulations

ggRandomForests: Exploring Random Forest Survival

2016-12-28 · John Ehrlinger

Random forest (Leo Breiman 2001a) (RF) is a non-parametric statistical method requiring no distributional assumptions on covariate relation to the response. RF is a robust, nonlinear technique that optimizes predictive a…

Information RetrievalRetrieval