paper-with-me

홈 › Papers

Linear Models, Variable Selection, Artificial Intelligence

2026-04-29 · By Riyadh Alrawkan, Edward Boone, Ryad Ghanam, Anton Westveld arxiv

Variable selection in linear regression models has been a problem since hypothesis testing began. Which variables to include or exclude from a model is not an easy task. Techniques such as Forward, Back ward, Stepwise Regression sequentially add or delete variables from a model. Penalized likelihood methods such as AIC, BIC, etc. seek to choose variables that have a significant contribution to the likelihood. Penalized sum of square methods such as LASSO and Elastic Net have been used to penalize small coefficients to only allow variables with large coefficients in the model. This work introduces an Artificial Intelligence approach to model selection where an ANN is trained to determine the significance of the variables based on OLS estimates. A simulation study shows the accuracy across various sample sizes and variances. Furthermore, a simulation study is conducted to compare the performance of the approach against Forward, Backward, AIC, BIC and LASSO. The approach is illustrated using a dataset from the World Health Organization regarding Life Expectancy. A github link is provided to the pretrained ANN that can handle up to 100 predictor variables, the original WHO dataset and the subset used in this work.

📄 PDF Abstract BibTeX arXiv:2604.27191

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Variable Selection Methods for Multivariate, Functional, and Complex Biomedical Data in the AI Age

2025-01-12 · Marcos Matabuena

Many problems within personalized medicine and digital health rely on the analysis of continuous-time functional biomarkers and other complex data structures emerging from high-resolution patient monitoring. In this cont…

Additive modelsregressionVariable Selection

Enhancing Feature Selection and Interpretability in AI Regression Tasks Through Feature Attribution

2024-09-25 · Alexander Hinterleitner, Thomas Bartz-Beielstein, Richard Schulz, Sebastian Spengler 외

Research in Explainable Artificial Intelligence (XAI) is increasing, aiming to make deep learning models more transparent. Most XAI methods focus on justifying the decisions made by Artificial Intelligence (AI) systems i…

Deep LearningExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)feature selection+1

Knowledge Transfer Between Artificial Intelligence Systems

2017-09-05 · Ivan Y. Tyukin, Alexander N. Gorban, Konstantin Sofeikov, Ilya Romanenko

We consider the fundamental question: how a legacy "student" Artificial Intelligent (AI) system could learn from a legacy "teacher" AI system or a human expert without complete re-training and, most importantly, without …

Transfer Learning

Integrating Artificial Intelligence and Mixed Integer Linear Programming: Explainable Graph-Based Instance Space Analysis in Air Transportation

2025-12-01 · Artur Guerra Rosa, Felipe Tavares Loureiro, Marcus Vinicius Santos da Silva, Andréia Elizabeth Silva Barros 외 arxiv

This paper analyzes the integration of artificial intelligence (AI) with mixed integer linear programming (MILP) to address complex optimization challenges in air transportation with explainability. The study aims to val…

Dimensionality ReductionFeature Engineering

Adaptability of Improved NEAT in Variable Environments

2021-10-22 · Destiny Bailey

A large challenge in Artificial Intelligence (AI) is training control agents that can properly adapt to variable environments. Environments in which the conditions change can cause issues for agents trying to operate in …

feature selection