paper-with-me

Papers

Impact of Comprehensive Data Preprocessing on Predictive Modelling of COVID-19 Mortality

2024-08-15 · Sangita Das, Subhrajyoti Maji

Accurate predictive models are crucial for analysing COVID-19 mortality trends. This study evaluates the impact of a custom data preprocessing pipeline on ten machine learning models predicting COVID-19 mortality using data from Our World in Data (OWID). Our pipeline differs from a standard preprocessing pipeline through four key steps. Firstly, it transforms weekly reported totals into daily updates, correcting reporting biases and providing more accurate estimates. Secondly, it uses localised outlier detection and processing to preserve data variance and enhance accuracy. Thirdly, it utilises computational dependencies among columns to ensure data consistency. Finally, it incorporates an iterative feature selection process to optimise the feature set and improve model performance. Results show a significant improvement with the custom pipeline: the MLP Regressor achieved a test RMSE of 66.556 and a test R-squared of 0.991, surpassing the DecisionTree Regressor from the standard pipeline, which had a test RMSE of 222.858 and a test R-squared of 0.817. These findings highlight the importance of tailored preprocessing techniques in enhancing predictive modelling accuracy for COVID-19 mortality. Although specific to this study, these methodologies offer valuable insights into diverse datasets and domains, improving predictive performance across various contexts.

📄 PDF Abstract BibTeX arXiv:2408.08142

Code (1)

dassangita844/preprocessing_covid-19_dataset_india 공식 구현

Tasks

feature selectionOutlier Detection

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

Empirical Evaluations of Preprocessing Parameters' Impact on Predictive Coding's Effectiveness

2019-04-03 · Rishi Chhatwal, Nathaniel Huber-Fliflet, Robert Keeling, Jianping Zhang 외

Predictive coding, once used in only a small fraction of legal and business matters, is now widely deployed to quickly cull through increasingly vast amounts of data and reduce the need for costly and inefficient human d…

Investigating the Impact of Balancing, Filtering, and Complexity on Predictive Multiplicity: A Data-Centric Perspective

2024-12-12 · Mustafa Cavus, Przemyslaw Biecek

The Rashomon effect presents a significant challenge in model selection. It occurs when multiple models achieve similar performance on a dataset but produce different predictions, resulting in predictive multiplicity. Th…

Model Selection

Leveraging MIMIC Datasets for Better Digital Health: A Review on Open Problems, Progress Highlights, and Future Promises

2025-06-15 · Afifa Khaled, Mohammed Sabir, Rizwan Qureshi, Camillo Maria Caruso 외

The Medical Information Mart for Intensive Care (MIMIC) datasets have become the Kernel of Digital Health Research by providing freely accessible, deidentified records from tens of thousands of critical care admissions, …

Causal InferenceData IntegrationDimensionality ReductionFederated Learning+2

On the cross-validation bias due to unsupervised pre-processing

2019-01-25 · Amit Moscovich, Saharon Rosset

Cross-validation is the de facto standard for predictive model evaluation and selection. In proper use, it provides an unbiased estimate of a model's predictive performance. However, data sets often undergo various forms…

Dimensionality Reductionfeature selectionModel Selection

BEFANA: A Tool for Biodiversity-Ecosystem Functioning Assessment by Network Analysis

2022-03-21 · Martin Marzidovšek, Vid Podpečan, Erminia Conti, Marko Debeljak 외

BEFANA is a free and open-source software tool for ecological network analysis and visualisation. It is adapted to ecologists' needs and allows them to study the topology and dynamics of ecological networks as well as ap…

BIG-bench Machine Learning