paper-with-me

홈 › Papers

Are Linear Regression Models White Box and Interpretable?

2024-07-16 · Ahmed M Salih, Yuhe Wang

Explainable artificial intelligence (XAI) is a set of tools and algorithms that applied or embedded to machine learning models to understand and interpret the models. They are recommended especially for complex or advanced models including deep neural network because they are not interpretable from human point of view. On the other hand, simple models including linear regression are easy to implement, has less computational complexity and easy to visualize the output. The common notion in the literature that simple models including linear regression are considered as "white box" because they are more interpretable and easier to understand. This is based on the idea that linear regression models have several favorable outcomes including the effect of the features in the model and whether they affect positively or negatively toward model output. Moreover, uncertainty of the model can be measured or estimated using the confidence interval. However, we argue that this perception is not accurate and linear regression models are not easy to interpret neither easy to understand considering common XAI metrics and possible challenges might face. This includes linearity, local explanation, multicollinearity, covariates, normalization, uncertainty, features contribution and fairness. Consequently, we recommend the so-called simple models should be treated equally to complex models when it comes to explainability and interpretability.

📄 PDF Abstract BibTeX arXiv:2407.12177

Code (0)

등록된 구현이 없습니다.

Tasks

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Fairnessregression

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

Orthogonal Discrepancy Kernels for Learning with Partial Physics

2026-06-19 · Swapnil Manna, Timothy J. Rogers, Lawrence Bull arxiv

We introduce a semi-parametric framework for nonlinear system identification, which decouples discrepancy functions from physics-based components. Orthogonal Gaussian process regression balances sparse parameter selectio…

Implicit ZCA Whitening Effects of Linear Autoencoders for Recommendation

2023-08-15 · Katsuhiko Hayashi, Kazuma Onishi

Recently, in the field of recommendation systems, linear regression (autoencoder) models have been investigated as a way to learn item similarity. In this paper, we show a connection between a linear autoencoder model an…

Recommendation Systemsregression

Interpretability in Symbolic Regression: a benchmark of Explanatory Methods using the Feynman data set

2024-04-08 · Guilherme Seidyo Imai Aldeia, Fabricio Olivetti de Franca

In some situations, the interpretability of the machine learning models plays a role as important as the model accuracy. Interpretability comes from the need to trust the prediction model, verify some of its properties, …

FairnessregressionSymbolic Regression

A Locally Adaptive Interpretable Regression

2020-05-07 · Lkhagvadorj Munkhdalai, Tsendsuren Munkhdalai, Keun Ho Ryu

Machine learning models with both good predictability and high interpretability are crucial for decision support systems. Linear regression is one of the most interpretable prediction models. However, the linearity in a …

BIG-bench Machine LearningEconometricsregression

Symbolic Quantile Regression for the Interpretable Prediction of Conditional Quantiles

2025-08-11 · Cas Oude Hoekstra, Floris den Hengst arxiv

Symbolic Regression (SR) is a well-established framework for generating interpretable or white-box predictive models. Although SR has been successfully applied to create interpretable estimates of the average of the outc…