paper-with-me

홈 › Papers

Supervised Feature Selection with Neuron Evolution in Sparse Neural Networks

2023-03-10 · Zahra Atashgahi, Xuhao Zhang, Neil Kichler, Shiwei Liu, Lu Yin, Mykola Pechenizkiy, Raymond Veldhuis, Decebal Constantin Mocanu

Feature selection that selects an informative subset of variables from data not only enhances the model interpretability and performance but also alleviates the resource demands. Recently, there has been growing attention on feature selection using neural networks. However, existing methods usually suffer from high computational costs when applied to high-dimensional datasets. In this paper, inspired by evolution processes, we propose a novel resource-efficient supervised feature selection method using sparse neural networks, named \enquote{NeuroFS}. By gradually pruning the uninformative features from the input layer of a sparse neural network trained from scratch, NeuroFS derives an informative subset of features efficiently. By performing several experiments on $11$ low and high-dimensional real-world benchmarks of different types, we demonstrate that NeuroFS achieves the highest ranking-based score among the considered state-of-the-art supervised feature selection models. The code is available on GitHub.

📄 PDF Abstract BibTeX arXiv:2303.07200

Code (1)

zahraatashgahi/neurofs 공식 구현 tf

Tasks

feature selection

Methods 이 논문이 사용한 방법론

Pruning 설명 없음
Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

Quick and Robust Feature Selection: the Strength of Energy-efficient Sparse Training for Autoencoders

2020-12-01 · Zahra Atashgahi, Ghada Sokar, Tim Van der Lee, Elena Mocanu 외

Major complications arise from the recent increase in the amount of high-dimensional data, including high computational costs and memory requirements. Feature selection, which identifies the most relevant and informative…

ClusteringDenoisingDimensionality ReductionFeature Importance+1

EntryPrune: Neural Network Feature Selection using First Impressions

2024-10-03 · Felix Zimmer, Patrik Okanovic, Torsten Hoefler

There is an ongoing effort to develop feature selection algorithms to improve interpretability, reduce computational resources, and minimize overfitting in predictive models. Neural networks stand out as architectures on…

feature selection

Unveiling the Power of Sparse Neural Networks for Feature Selection

2024-08-08 · Zahra Atashgahi, Tennison Liu, Mykola Pechenizkiy, Raymond Veldhuis 외

Sparse Neural Networks (SNNs) have emerged as powerful tools for efficient feature selection. Leveraging the dynamic sparse training (DST) algorithms within SNNs has demonstrated promising feature selection capabilities …

Feature Importancefeature selection

Coevolution of Neural Architectures and Features for Stock Market Forecasting: A Multi-objective Decision Perspective

2023-11-23 · Faizal Hafiz, Jan Broekaert, Davide La Torre, Akshya Swain

In a multi objective setting, a portfolio manager's highly consequential decisions can benefit from assessing alternative forecasting models of stock index movement. The present investigation proposes a new approach to i…

Evolutionary Algorithmsfeature selection

Online Sparse Feature Selection in Data Streams via Differential Evolution

2025-11-24 · Ruiyang Xu arxiv

The processing of high-dimensional streaming data commonly utilizes online streaming feature selection (OSFS) techniques. However, practical implementations often face challenges with data incompleteness due to equipment…

Feature Importance