paper-with-me

홈 › Papers

Evaluation of Missing Data Analytical Techniques in Longitudinal Research: Traditional and Machine Learning Approaches

2024-06-19 · Dandan Tang, Xin Tong

Missing Not at Random (MNAR) and nonnormal data are challenging to handle. Traditional missing data analytical techniques such as full information maximum likelihood estimation (FIML) may fail with nonnormal data as they are built on normal distribution assumptions. Two-Stage Robust Estimation (TSRE) does manage nonnormal data, but both FIML and TSRE are less explored in longitudinal studies under MNAR conditions with nonnormal distributions. Unlike traditional statistical approaches, machine learning approaches do not require distributional assumptions about the data. More importantly, they have shown promise for MNAR data; however, their application in longitudinal studies, addressing both Missing at Random (MAR) and MNAR scenarios, is also underexplored. This study utilizes Monte Carlo simulations to assess and compare the effectiveness of six analytical techniques for missing data within the growth curve modeling framework. These techniques include traditional approaches like FIML and TSRE, machine learning approaches by single imputation (K-Nearest Neighbors and missForest), and machine learning approaches by multiple imputation (micecart and miceForest). We investigate the influence of sample size, missing data rate, missing data mechanism, and data distribution on the accuracy and efficiency of model estimation. Our findings indicate that FIML is most effective for MNAR data among the tested approaches. TSRE excels in handling MAR data, while missForest is only advantageous in limited conditions with a combination of very skewed distributions, very large sample sizes (e.g., n larger than 1000), and low missing data rates.

📄 PDF Abstract BibTeX arXiv:2406.13814

Code (1)

DandanTang0/Evaluation-of-Missing-Data-Analytical-Techniques-in-Longitudinal-Research 공식 구현

Tasks

Imputation

Similar Papers 제목 키워드 기반

MUSE-Net: Missingness-aware mUlti-branching Self-attention Encoder for Irregular Longitudinal Electronic Health Records

2024-06-30 · Zekai Wang, Tieming Liu, Bing Yao

The era of big data has made vast amounts of clinical data readily available, particularly in the form of electronic health records (EHRs), which provides unprecedented opportunities for developing data-driven diagnostic…

Decision MakingDiagnosticDisease PredictionImputation

Multi-task longitudinal forecasting with missing values on Alzheimer's Disease

2022-01-13 · Carlos Sevilla-Salcedo, Vandad Imani, Pablo M. Olmos, Vanessa Gómez-Verdejo 외

Machine learning techniques typically applied to dementia forecasting lack in their capabilities to jointly learn several tasks, handle time dependent heterogeneous data and missing values. In this paper, we propose a fr…

ImputationMissing ValuesVariational Inference

L-FAME: Longitudinal Focused Attention Meditation EEG Dataset and Benchmark

2026-05-21 · Angqi Li, Ab Basit Rafi Syed, Hamzeh Alzweri, Taosheng Liu 외 arxiv

We introduce a novel Longitudinal Focused Attention Meditation Electroencephalography (L-FAME) dataset and an accompanying benchmark, designed to foster research into the neural effects of various meditation practices an…

On Testability and Goodness of Fit Tests in Missing Data Models

2022-02-28 · Razieh Nabi, Rohit Bhattacharya

Significant progress has been made in developing identification and estimation techniques for missing data problems where modeling assumptions can be described via a directed acyclic graph. The validity of results using …

Missingness as Stability: Understanding the Structure of Missingness in Longitudinal EHR data and its Impact on Reinforcement Learning in Healthcare

2019-11-16 · Scott L. Fleming, Kuhan Jeyapragasan, Tony Duan, Daisy Ding 외

There is an emerging trend in the reinforcement learning for healthcare literature. In order to prepare longitudinal, irregularly sampled, clinical datasets for reinforcement learning algorithms, many researchers will re…

Imputationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+2