paper-with-me

Papers

Comparative Analysis of Data Preprocessing Methods, Feature Selection Techniques and Machine Learning Models for Improved Classification and Regression Performance on Imbalanced Genetic Data

2024-02-22 · Arshmeet Kaur, Morteza Sarmadi

Rapid advancements in genome sequencing have led to the collection of vast amounts of genomics data. Researchers may be interested in using machine learning models on such data to predict the pathogenicity or clinical significance of a genetic mutation. However, many genetic datasets contain imbalanced target variables that pose challenges to machine learning models: observations are skewed/imbalanced in regression tasks or class-imbalanced in classification tasks. Genetic datasets are also often high-cardinal and contain skewed predictor variables, which poses further challenges. We aimed to investigate the effects of data preprocessing, feature selection techniques, and model selection on the performance of models trained on these datasets. We measured performance with 5-fold cross-validation and compared averaged r-squared and accuracy metrics across different combinations of techniques. We found that outliers/skew in predictor or target variables did not pose a challenge to regression models. We also found that class-imbalanced target variables and skewed predictors had little to no impact on classification performance. Random forest was the best model to use for imbalanced regression tasks. While our study uses a genetic dataset as an example of a real-world application, our findings can be generalized to any similar datasets.

📄 PDF Abstract BibTeX arXiv:2402.14980

Code (0)

등록된 구현이 없습니다.

Tasks

feature selectionModel Selectionregression

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

A Comparative Study of Text Preprocessing Approaches for Topic Detection of User Utterances

2016-05-01 · LREC 2016 5 · Roman Sergienko, Muhammad Shan, Wolfgang Minker

The paper describes a comparative study of existing and novel text preprocessing and classification techniques for domain detection of user utterances. Two corpora are considered. The first one contains customer calls to…

ClassificationClusteringDimensionality Reductionfeature selection+1

A Multi-Step Comparative Framework for Anomaly Detection in IoT Data Streams

2025-05-22 · Mohammed Al-Qudah, Fadi AlMahamid

The rapid expansion of Internet of Things (IoT) devices has introduced critical security challenges, underscoring the need for accurate anomaly detection. Although numerous studies have proposed machine learning (ML) met…

Anomaly Detectionfeature selection

Comparative Analysis of Methods for Cloud Segmentation in Ground-Based Infrared Images

2020-12-13 · Guillermo Terrén-Serrano, Manel Martínez-Ramón

The increasing penetration of photovoltaic systems in the power grid makes it vulnerable to cloud shadow projection. Real-time cloud segmentation in ground-based infrared images is important to reduce the noise in intra-…

SegmentationSolar Irradiance Forecasting

A comprehensive survey on computational learning methods for analysis of gene expression data

2022-02-07 · Nikita Bhandari, Rahee Walambe, Ketan Kotecha, Satyajeet Khare

Computational analysis methods including machine learning have a significant impact in the fields of genomics and medicine. High-throughput gene expression analysis methods such as microarray technology and RNA sequencin…

Dimensionality Reductionfeature selectionImputationMissing Values

A comparative study of neural network techniques for automatic software vulnerability detection

2021-04-29 · Gaigai Tang, Lianxiao Meng, Shuangyin Ren, Weipeng Cao 외

Software vulnerabilities are usually caused by design flaws or implementation errors, which could be exploited to cause damage to the security of the system. At present, the most commonly used method for detecting softwa…

Vulnerability Detection