paper-with-me

홈 › Papers

SFE: A Simple, Fast and Efficient Feature Selection Algorithm for High-Dimensional Data

2023-03-17 · Behrouz Ahadzadeh, Moloud Abdar, Fatemeh Safara, Abbas Khosravi, Mohammad Bagher Menhaj, Ponnuthurai Nagaratnam Suganthan

In this paper, a new feature selection algorithm, called SFE (Simple, Fast, and Efficient), is proposed for high-dimensional datasets. The SFE algorithm performs its search process using a search agent and two operators: non-selection and selection. It comprises two phases: exploration and exploitation. In the exploration phase, the non-selection operator performs a global search in the entire problem search space for the irrelevant, redundant, trivial, and noisy features, and changes the status of the features from selected mode to non-selected mode. In the exploitation phase, the selection operator searches the problem search space for the features with a high impact on the classification results, and changes the status of the features from non-selected mode to selected mode. The proposed SFE is successful in feature selection from high-dimensional datasets. However, after reducing the dimensionality of a dataset, its performance cannot be increased significantly. In these situations, an evolutionary computational method could be used to find a more efficient subset of features in the new and reduced search space. To overcome this issue, this paper proposes a hybrid algorithm, SFE-PSO (particle swarm optimization) to find an optimal feature subset. The efficiency and effectiveness of the SFE and the SFE-PSO for feature selection are compared on 40 high-dimensional datasets. Their performances were compared with six recently proposed feature selection algorithms. The results obtained indicate that the two proposed algorithms significantly outperform the other algorithms, and can be used as efficient and effective algorithms in selecting features from high-dimensional datasets.

📄 PDF Abstract BibTeX arXiv:2303.10182

Code (1)

ahadzadeh2022/sfe 공식 구현

Tasks

feature selection

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

Large-scale Online Feature Selection for Ultra-high Dimensional Sparse Data

2014-09-27 · Yue Wu, Steven C. H. Hoi, Tao Mei, Nenghai Yu

Feature selection with large-scale high-dimensional data is important yet very challenging in machine learning and data mining. Online feature selection is a promising new paradigm that is more efficient and scalable tha…

feature selectionVocal Bursts Intensity Prediction

Fast Feature Reduction in intrusion detection datasets

2013-04-01 · Shafigh Parsazad, Ehsan Saboori, Amin Allahyar

In the most intrusion detection systems (IDS), a system tries to learn characteristics of different type of attacks by analyzing packets that sent or received in network. These packets have a lot of features. But not all…

feature selectionIntrusion Detection

Fast Instrument Learning with Faster Rates

2022-05-22 · Ziyu Wang, Yuhao Zhou, Jun Zhu

We investigate nonlinear instrumental variable (IV) regression given high-dimensional instruments. We propose a simple algorithm which combines kernelized IV methods and an arbitrary, adaptive regression algorithm, acces…

Model SelectionregressionUncertainty Quantification

Multi-objective Binary Coordinate Search for Feature Selection

2024-02-20 · Sevil Zanjani Miyandoab, Shahryar Rahnamayan, Azam Asilian Bidgoli

A supervised feature selection method selects an appropriate but concise set of features to differentiate classes, which is highly expensive for large-scale datasets. Therefore, feature selection should aim at both minim…

feature selection

MrSQM: Fast Time Series Classification with Symbolic Representations

2021-09-02 · Thach Le Nguyen, Georgiana Ifrim

Symbolic representations of time series have proven to be effective for time series classification, with many recent approaches including SAX-VSM, BOSS, WEASEL, and MrSEQL. The key idea is to transform numerical time ser…

Classificationfeature selectionTime SeriesTime Series Analysis+1