paper-with-me

Papers

Lifting Interpretability-Performance Trade-off via Automated Feature Engineering

2020-02-11 · Alicja Gosiewska, Przemyslaw Biecek

Complex black-box predictive models may have high performance, but lack of interpretability causes problems like lack of trust, lack of stability, sensitivity to concept drift. On the other hand, achieving satisfactory accuracy of interpretable models require more time-consuming work related to feature engineering. Can we train interpretable and accurate models, without timeless feature engineering? We propose a method that uses elastic black-boxes as surrogate models to create a simpler, less opaque, yet still accurate and interpretable glass-box models. New models are created on newly engineered features extracted with the help of a surrogate model. We supply the analysis by a large-scale benchmark on several tabular data sets from the OpenML database. There are two results 1) extracting information from complex models may improve the performance of linear models, 2) questioning a common myth that complex machine learning models outperform linear models.

📄 PDF Abstract BibTeX arXiv:2002.04267

Code (1)

agosiewska/SAFE-experiments

Tasks

Automated Feature EngineeringFeature Engineering

Methods 이 논문이 사용한 방법론

Interpretability 설명 없음

Similar Papers 제목 키워드 기반

LifWavNet: Lifting Wavelet-based Network for Non-contact ECG Reconstruction from Radar

2025-10-31 · Soumitra Kundu, Gargi Panda, Saumik Bhattacharya, Aurobinda Routray 외 arxiv

Non-contact electrocardiogram (ECG) reconstruction from radar signals offers a promising approach for unobtrusive cardiac monitoring. We present LifWavNet, a lifting wavelet network based on a multi-resolution analysis a…

Learning-based safety lifting monitoring system for cranes on construction sites

2025-06-25 · Hao Chen, Yu Hin Ng, Ching-Wei Chang, Haobo Liang 외

Lifting on construction sites, as a frequent operation, works still with safety risks, especially for modular integrated construction (MiC) lifting due to its large weight and size, probably leading to accidents, causing…

Balancing the Tradeoff Between Clustering Value and Interpretability

2019-12-17 · Sandhya Saisubramanian, Sainyam Galhotra, Shlomo Zilberstein

Graph clustering groups entities -- the vertices of a graph -- based on their similarity, typically using a complex distance function over a large number of features. Successful integration of clustering approaches in au…

ClusteringGraph Clustering

Towards Interpretable Soft Prompts

2025-04-02 · Oam Patel, Jason Wang, Nikhil Shivakumar Nayak, Suraj Srinivas 외

Soft prompts have been popularized as a cheap and easy way to improve task-specific LLM performance beyond few-shot prompts. Despite their origin as an automated prompting method, however, soft prompts and other trainabl…

Explicitising The Implicit Intrepretability of Deep Neural Networks Via Duality

2022-03-01 · Chandrashekar Lakshminarayanan, Amit Vikram Singh, Arun Rajkumar

Recent work by Lakshminarayanan and Singh [2020] provided a dual view for fully connected deep neural networks (DNNs) with rectified linear units (ReLU). It was shown that (i) the information in the gates is analytically…