paper-with-me

홈 › Papers

A Semiparametric Approach to Interpretable Machine Learning

2020-06-08 · Numair Sani, Jaron Lee, Razieh Nabi, Ilya Shpitser

Black box models in machine learning have demonstrated excellent predictive performance in complex problems and high-dimensional settings. However, their lack of transparency and interpretability restrict the applicability of such models in critical decision-making processes. In order to combat this shortcoming, we propose a novel approach to trading off interpretability and performance in prediction models using ideas from semiparametric statistics, allowing us to combine the interpretability of parametric regression models with performance of nonparametric methods. We achieve this by utilizing a two-piece model: the first piece is interpretable and parametric, to which a second, uninterpretable residual piece is added. The performance of the overall model is optimized using methods from the sufficient dimension reduction literature. Influence function based estimators are derived and shown to be doubly robust. This allows for use of approaches such as double Machine Learning in estimating our model parameters. We illustrate the utility of our approach via simulation studies and a data application based on predicting the length of stay in the intensive care unit among surgery patients.

📄 PDF Abstract BibTeX arXiv:2006.04732

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningDecision MakingDimensionality ReductionInterpretable Machine Learning

Methods 이 논문이 사용한 방법론

Interpretability 설명 없음

Similar Papers 제목 키워드 기반

Trustworthy Predictive Distributions for Tail Events with Semiparametric Diagnostic Transport Maps

2026-03-11 · Elizabeth Cucuzzella, Rafael Izbicki, Ann B. Lee arxiv

Machine learning forecast systems are moving beyond point predictions to full predictive distributions for future outcomes y conditional on complex inputs x. However, these distributions are often locally miscalibrated, …

High Dimensional Semiparametric Scale-Invariant Principal Component Analysis

2014-02-18 · Fang Han, Han Liu

We propose a new high dimensional semiparametric principal component analysis (PCA) method, named Copula Component Analysis (COCA). The semiparametric model assumes that, after unspecified marginally monotone transformat…

feature selectionVocal Bursts Intensity Prediction

Semiparametric Latent Topic Modeling on Consumer-Generated Corpora

2021-07-13 · Dominic B. Dayta, Erniel B. Barrios

Legacy procedures for topic modelling have generally suffered problems of overfitting and a weakness towards reconstructing sparse topic structures. With motivation from a consumer-generated corpora, this paper proposes …

regression

A Simple and General Debiased Machine Learning Theorem with Finite Sample Guarantees

2021-05-31 · Victor Chernozhukov, Whitney K. Newey, Rahul Singh

Debiased machine learning is a meta algorithm based on bias correction and sample splitting to calculate confidence intervals for functionals, i.e. scalar summaries, of machine learning algorithms. For example, an analys…

BIG-bench Machine LearningLearning Theory

Binned semiparametric Bayesian networks

2025-06-27 · Rafael Sojo, Javier Díaz-Rozo, Concha Bielza, Pedro Larrañaga

This paper introduces a new type of probabilistic semiparametric model that takes advantage of data binning to reduce the computational cost of kernel density estimation in nonparametric distributions. Two new conditiona…

Density Estimation