paper-with-me

Papers

LLpowershap: Logistic Loss-based Automated Shapley Values Feature Selection Method

2024-01-23 · Iqbal Madakkatel, Elina Hyppönen

Shapley values have been used extensively in machine learning, not only to explain black box machine learning models, but among other tasks, also to conduct model debugging, sensitivity and fairness analyses and to select important features for robust modelling and for further follow-up analyses. Shapley values satisfy certain axioms that promote fairness in distributing contributions of features toward prediction or reducing error, after accounting for non-linear relationships and interactions when complex machine learning models are employed. Recently, a number of feature selection methods utilising Shapley values have been introduced. Here, we present a novel feature selection method, LLpowershap, which makes use of loss-based Shapley values to identify informative features with minimal noise among the selected sets of features. Our simulation results show that LLpowershap not only identifies higher number of informative features but outputs fewer noise features compared to other state-of-the-art feature selection methods. Benchmarking results on four real-world datasets demonstrate higher or at par predictive performance of LLpowershap compared to other Shapley based wrapper methods, or filter methods.

📄 PDF Abstract BibTeX arXiv:2401.12683

Code (1)

madakkmi/llpowershap 공식 구현 tf

Tasks

BenchmarkingFairnessfeature selection

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

Explainable AI based System for Supply Air Temperature Forecast

2025-01-09 · Marika Eik, Ahmet Kose, Hossein Nourollahi Hokmabad, Juri Belikov

This paper explores the application of Explainable AI (XAI) techniques to improve the transparency and understanding of predictive models in control of automated supply air temperature (ASAT) of Air Handling Unit (AHU). …

Machine Learning Workflow to Explain Black-box Models for Early Alzheimer's Disease Classification Evaluated for Multiple Datasets

2022-05-12 · Louise Bloch, Christoph M. Friedrich

Purpose: Hard-to-interpret Black-box Machine Learning (ML) were often used for early Alzheimer's Disease (AD) detection. Methods: To interpret eXtreme Gradient Boosting (XGBoost), Random Forest (RF), and Support Vector M…

FW-Shapley: Real-time Estimation of Weighted Shapley Values

2025-03-09 · Pranoy Panda, Siddharth Tandon, Vineeth N Balasubramanian

Fair credit assignment is essential in various machine learning (ML) applications, and Shapley values have emerged as a valuable tool for this purpose. However, in critical ML applications such as data valuation and feat…

Data Valuation

Shap-Select: Lightweight Feature Selection Using SHAP Values and Regression

2024-10-09 · Egor Kraev, Baran Koseoglu, Luca Traverso, Mohammed Topiwalla

Feature selection is an essential process in machine learning, especially when dealing with high-dimensional datasets. It helps reduce the complexity of machine learning models, improve performance, mitigate overfitting,…

Computational Efficiencyfeature selectionregressiontabular-regression

Joint Shapley values: a measure of joint feature importance

2021-07-23 · ICLR 2022 4 · Chris Harris, Richard Pymar, Colin Rowat

The Shapley value is one of the most widely used measures of feature importance partly as it measures a feature's average effect on a model's prediction. We introduce joint Shapley values, which directly extend Shapley's…

Feature Importance