paper-with-me

Papers

Interpretable Network-assisted Random Forest+

2025-09-19 · Tiffany M. Tang, Elizaveta Levina, Ji Zhu arxiv

Machine learning algorithms often assume that training samples are independent. When data points are connected by a network, the induced dependency between samples is both a challenge, reducing effective sample size, and an opportunity to improve prediction by leveraging information from network neighbors. Multiple methods taking advantage of this opportunity are now available, but many, including graph neural networks, are not easily interpretable, limiting their usefulness for understanding how a model makes its predictions. Others, such as network-assisted linear regression, are interpretable but often yield substantially worse prediction performance. We bridge this gap by proposing a family of flexible network-assisted models built upon a generalization of random forests (RF+), which achieves highly-competitive prediction accuracy and can be interpreted through feature importance measures. In particular, we develop a suite of interpretation tools that enable practitioners to not only identify important features that drive model predictions, but also quantify the importance of the network contribution to prediction. Importantly, we provide both global and local importance measures as well as sample influence measures to assess the impact of a given observation. This suite of tools broadens the scope and applicability of network-assisted machine learning for high-impact problems where interpretability and transparency are essential.

📄 PDF Abstract BibTeX arXiv:2509.15611

Code (0)

등록된 구현이 없습니다.

Tasks

Feature Importance

Similar Papers 제목 키워드 기반

Data-assisted combustion simulations with dynamic submodel assignment using random forests

2020-09-08 · Wai Tong Chung, Aashwin Ananda Mishra, Nikolaos Perakis, Matthias Ihme

In this investigation, we outline a data-assisted approach that employs random forest classifiers for local and dynamic combustion submodel assignment in turbulent-combustion simulations. This method is applied in simula…

Random Planted Forest: a directly interpretable tree ensemble

2020-12-29 · Munir Hiabu, Enno Mammen, Joseph T. Meyer

We introduce a novel interpretable tree based algorithm for prediction in a regression setting. Our motivation is to estimate the unknown regression function from a functional decomposition perspective in which the funct…

regression

Learning Interpretable Characteristic Kernels via Decision Forests

2018-11-30 · Sambit Panda, Cencheng Shen, Joshua T. Vogelstein

Decision forests are widely used for classification and regression tasks. A lesser known property of tree-based methods is that one can construct a proximity matrix from the tree(s), and these proximity matrices are indu…

Feature ImportanceGeneral Classification

SIRUS: Stable and Interpretable RUle Set for Classification

2019-08-19 · Clément Bénard, Gérard Biau, Sébastien da Veiga, Erwan Scornet

State-of-the-art learning algorithms, such as random forests or neural networks, are often qualified as "black-boxes" because of the high number and complexity of operations involved in their prediction mechanism. This l…

ClassificationGeneral Classification

LionForests: Local Interpretation of Random Forests

2019-11-20 · Ioannis Mollas, Nick Bassiliades, Ioannis Vlahavas, Grigorios Tsoumakas

Towards a future where machine learning systems will integrate into every aspect of people's lives, researching methods to interpret such systems is necessary, instead of focusing exclusively on enhancing their performan…

BIG-bench Machine Learning