paper-with-me

Papers

Enhancing Feature Selection and Interpretability in AI Regression Tasks Through Feature Attribution

2024-09-25 · Alexander Hinterleitner, Thomas Bartz-Beielstein, Richard Schulz, Sebastian Spengler, Thomas Winter, Christoph Leitenmeier

Research in Explainable Artificial Intelligence (XAI) is increasing, aiming to make deep learning models more transparent. Most XAI methods focus on justifying the decisions made by Artificial Intelligence (AI) systems in security-relevant applications. However, relatively little attention has been given to using these methods to improve the performance and robustness of deep learning algorithms. Additionally, much of the existing XAI work primarily addresses classification problems. In this study, we investigate the potential of feature attribution methods to filter out uninformative features in input data for regression problems, thereby improving the accuracy and stability of predictions. We introduce a feature selection pipeline that combines Integrated Gradients with k-means clustering to select an optimal set of variables from the initial data space. To validate the effectiveness of this approach, we apply it to a real-world industrial problem - blade vibration analysis in the development process of turbo machinery.

📄 PDF Abstract BibTeX arXiv:2409.16787

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)feature selectionregression

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…
k-Means Clustering k-Means Clustering is a clustering algorithm that divides a training set into $k$ different clusters of examples that are near each other. It works by initializing $k$…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Interpretable Feature Interaction via Statistical Self-supervised Learning on Tabular Data

2025-03-23 · Xiaochen Zhang, Haoyi Xiong

In high-dimensional and high-stakes contexts, ensuring both rigorous statistical guarantees and interpretability in feature extraction from complex tabular data remains a formidable challenge. Traditional methods such as…

feature selectionSelf-Supervised Learning

Shap-Select: Lightweight Feature Selection Using SHAP Values and Regression

2024-10-09 · Egor Kraev, Baran Koseoglu, Luca Traverso, Mohammed Topiwalla

Feature selection is an essential process in machine learning, especially when dealing with high-dimensional datasets. It helps reduce the complexity of machine learning models, improve performance, mitigate overfitting,…

Computational Efficiencyfeature selectionregressiontabular-regression

Enhancing ML Models Interpretability for Credit Scoring

2025-09-14 · Sagi Schwartz, Qinling Wang, Fang Fang arxiv

Predicting default is essential for banks to ensure profitability and financial stability. While modern machine learning methods often outperform traditional regression techniques, their lack of transparency limits their…

On Feature Selection Using Anisotropic General Regression Neural Network

2020-10-12 · Federico Amato, Fabian Guignard, Philippe Jacquet, Mikhail Kanevski

The presence of irrelevant features in the input dataset tends to reduce the interpretability and predictive quality of machine learning models. Therefore, the development of feature selection methods to recognize irrele…

BIG-bench Machine Learningfeature selectionregressionSensitivity

Feature graphs for interpretable unsupervised tree ensembles: centrality, interaction, and application in disease subtyping

2024-04-27 · Christel Sirocchi, Martin Urschler, Bastian Pfeifer

Interpretable machine learning has emerged as central in leveraging artificial intelligence within high-stakes domains such as healthcare, where understanding the rationale behind model predictions is as critical as achi…

Clusteringfeature selectionInterpretable Machine Learning