paper-with-me

홈 › Papers

Regularizing Black-box Models for Improved Interpretability (HILL 2019 Version)

2019-05-31 · Gregory Plumb, Maruan Al-Shedivat, Eric Xing, Ameet Talwalkar

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack guarantees about their explanation quality. We propose an alternative to these approaches by directly regularizing a black-box model for interpretability at training time. Our approach explicitly connects three key aspects of interpretable machine learning: (i) the model's innate explainability, (ii) the explanation system used at test time, and (iii) the metrics that measure explanation quality. Our regularization results in substantial improvement in terms of the explanation fidelity and stability metrics across a range of datasets and black-box explanation systems while slightly improving accuracy. Further, if the resulting model is still not sufficiently interpretable, the weight of the regularization term can be adjusted to achieve the desired trade-off between accuracy and interpretability. Finally, we justify theoretically that the benefits of explanation-based regularization generalize to unseen points.

📄 PDF Abstract BibTeX arXiv:1906.01431

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningInterpretable Machine Learning

Methods 이 논문이 사용한 방법론

Interpretability 설명 없음

Similar Papers 제목 키워드 기반

Regularizing Black-box Models for Improved Interpretability

2019-02-18 · NeurIPS 2020 12 · Gregory Plumb, Maruan Al-Shedivat, Angel Alexander Cabrera, Adam Perer 외

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, whose explanat…

BIG-bench Machine LearningInterpretable Machine Learning

Feature Optimization for Time Series Forecasting via Novel Randomized Uphill Climbing

2025-05-02 · Nguyen Van Thanh

Randomized Uphill Climbing is a lightweight, stochastic search heuristic that has delivered state of the art equity alpha factors for quantitative hedge funds. I propose to generalize RUC into a model agnostic feature op…

GPUMultivariate Time Series ForecastingTime SeriesTime Series Forecasting

Interpretability of Blackbox Machine Learning Models through Dataview Extraction and Shadow Model creation

2020-02-02 · Rupam Patir, Shubham Singhal, C. Anantaram, Vikram Goyal

Deep learning models trained using massive amounts of data tend to capture one view of the data and its associated mapping. Different deep learning models built on the same training data may capture different views of th…

BIG-bench Machine LearningDeep LearningExplanation Generation

Visual Interpretability for Deep Learning: a Survey

2018-02-02 · Quanshi Zhang, Song-Chun Zhu

This paper reviews recent studies in understanding neural-network representations and learning neural networks with interpretable/disentangled middle-layer representations. Although deep neural networks have exhibited su…

Deep LearningExplainable artificial intelligenceSurvey

Robust Variational Model Based Tailored UNet: Leveraging Edge Detector and Mean Curvature for Improved Image Segmentation

2025-12-08 · Kaili Qi, Zhongyi Huang, Wenli Yang arxiv

To address the challenge of segmenting noisy images with blurred or fragmented boundaries, this paper presents a robust version of Variational Model Based Tailored UNet (VM_TUNet), a hybrid framework that integrates vari…

Computational EfficiencyImage Segmentation