paper-with-me

홈 › Papers

Doctor Rashomon and the UNIVERSE of Madness: Variable Importance with Unobserved Confounding and the Rashomon Effect

2025-10-14 · Jon Donnelly, Srikar Katta, Emanuele Borgonovo, Cynthia Rudin arxiv

Variable importance (VI) methods are often used for hypothesis generation, feature selection, and scientific validation. In the standard VI pipeline, an analyst estimates VI for a single predictive model with only the observed features. However, the importance of a feature depends heavily on which other variables are included in the model, and essential variables are often omitted from observational datasets. Moreover, the VI estimated for one model is often not the same as the VI estimated for another equally-good model - a phenomenon known as the Rashomon Effect. We address these gaps by introducing UNobservables and Inference for Variable importancE using Rashomon SEts (UNIVERSE). Our approach adapts Rashomon sets - the sets of near-optimal models in a dataset - to produce bounds on the true VI even with missing features. We theoretically guarantee the robustness of our approach, show strong performance on semi-synthetic simulations, and demonstrate its utility in a credit risk task.

📄 PDF Abstract BibTeX arXiv:2510.12734

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Rashomon effect in Educational Research: Why More is Better Than One for Measuring the Importance of the Variables?

2024-12-02 · Jakub Kuzilek, Mustafa Çavuş

This study explores how the Rashomon effect influences variable importance in the context of student demographics used for academic outcomes prediction. Our research follows the way machine learning algorithms are employ…

Binary Classification

Exploring the Whole Rashomon Set of Sparse Decision Trees

2022-09-16 · Rui Xin, Chudi Zhong, Zhi Chen, Takuya Takagi 외

In any given machine learning problem, there may be many models that could explain the data almost equally well. However, most learning algorithms return only one of these models, leaving practitioners with no practical …

The Rashomon Importance Distribution: Getting RID of Unstable, Single Model-based Variable Importance

2023-09-24 · NeurIPS 2023 11 · Jon Donnelly, Srikar Katta, Cynthia Rudin, Edward P. Browne

Quantifying variable importance is essential for answering high-stakes questions in fields like genetics, public policy, and medicine. Current methods generally calculate variable importance for a given model trained on …

Amazing Things Come From Having Many Good Models

2024-07-05 · Cynthia Rudin, Chudi Zhong, Lesia Semenova, Margo Seltzer 외

The Rashomon Effect, coined by Leo Breiman, describes the phenomenon that there exist many equally good predictive models for the same dataset. This phenomenon happens for many real datasets and when it does, it sparks b…

Fairness

SORTeD Rashomon Sets of Sparse Decision Trees: Anytime Enumeration

2025-11-05 · Elif Arslan, Jacobus G. M. van der Linden, Serge Hoogendoorn, Marco Rinaldi 외 arxiv

Sparse decision tree learning provides accurate and interpretable predictive models that are ideal for high-stakes applications by finding the single most accurate tree within a (soft) size limit. Rather than relying on …