paper-with-me

홈 › Papers

A computational study on imputation methods for missing environmental data

2021-08-21 · Paul Dixneuf, Fausto Errico, Mathias Glaus

Data acquisition and recording in the form of databases are routine operations. The process of collecting data, however, may experience irregularities, resulting in databases with missing data. Missing entries might alter analysis efficiency and, consequently, the associated decision-making process. This paper focuses on databases collecting information related to the natural environment. Given the broad spectrum of recorded activities, these databases typically are of mixed nature. It is therefore relevant to evaluate the performance of missing data processing methods considering this characteristic. In this paper we investigate the performances of several missing data imputation methods and their application to the problem of missing data in environment. A computational study was performed to compare the method missForest (MF) with two other imputation methods, namely Multivariate Imputation by Chained Equations (MICE) and K-Nearest Neighbors (KNN). Tests were made on 10 pretreated datasets of various types. Results revealed that MF generally outperformed MICE and KNN in terms of imputation errors, with a more pronounced performance gap for mixed typed databases where MF reduced the imputation error up to 150%, when compared to the other methods. KNN was usually the fastest method. MF was then successfully applied to a case study on Quebec wastewater treatment plants performance monitoring. We believe that the present study demonstrates the pertinence of using MF as imputation method when dealing with missing environmental data.

📄 PDF Abstract BibTeX arXiv:2108.09500

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingImputation

Similar Papers 제목 키워드 기반

Denoising ESG: quantifying data uncertainty from missing data with Machine Learning and prediction intervals

2024-07-29 · Sergio Caprioli, Jacopo Foschi, Riccardo Crupi, Alessandro Sabatino

Environmental, Social, and Governance (ESG) datasets are frequently plagued by significant data gaps, leading to inconsistencies in ESG ratings due to varying imputation methods. This paper explores the application of es…

DenoisingImputationPrediction Intervals

Predicting blood pressure under circumstances of missing data: An analysis of missing data patterns and imputation methods using NHANES

2023-05-01 · Harish Chauhan, Nikunj Gupta, Zoe Haskell-Craig

The World Health Organization defines cardio-vascular disease (CVD) as "a group of disorders of the heart and blood vessels," including coronary heart disease and stroke (WHO 21). CVD is affected by "intermediate risk fa…

ImputationMissing Values

Unveiling the Secrets: How Masking Strategies Shape Time Series Imputation

2024-05-26 · Linglong Qian, Yiyuan Yang, Wenjie Du, Jun Wang 외

Time series imputation is a critical challenge in data mining, particularly in domains like healthcare and environmental monitoring, where missing data can compromise analytical outcomes. This study investigates the infl…

ImputationTime Series

Comparative Analysis of Machine Learning-Based Imputation Techniques for Air Quality Datasets with High Missing Data Rates

2024-12-18 · Sen Yan, David J. O'Connor, Xiaojun Wang, Noel E. O'Connor 외

Urban pollution poses serious health risks, particularly in relation to traffic-related air pollution, which remains a major concern in many cities. Vehicle emissions contribute to respiratory and cardiovascular issues, …

Imputation

Imputation of missing values in multi-view data

2022-10-26 · Wouter van Loon, Marjolein Fokkema, Frank de Vos, Marisa Koini 외

Data for which a set of objects is described by multiple distinct feature sets (called views) is known as multi-view data. When missing values occur in multi-view data, all features in a view are likely to be missing sim…

ImputationMeta-LearningMissing ValuesMULTI-VIEW LEARNING+1