paper-with-me

홈 › Papers

Survey-aware Machine Learning: A Guideline for Valid Population Health Inference based on Scoping Review

2026-05-09 · YongKyung Oh, Henry W. Zheng, Jeffrey Feng, Alex A. T. Bui arxiv

Machine Learning (ML) models trained on complex health surveys such as the National Health and Nutrition Examination Survey (NHANES) often ignore primary sampling units, stratification variables, and sampling weights. This practice violates the independence assumptions of standard evaluation methods. As a result, estimates become biased, uncertainty is underestimated, and fairness assessments fail to reflect population-level disparities. We propose Survey-aware Machine Learning (SaML), a nine-step guideline that incorporates survey design metadata across the ML lifecycle. Through a scoping review of 16 methodological papers, we summarize existing work on weighted model training, design-based cross-validation, and survey-adjusted performance evaluation. We also identify gaps in hyperparameter tuning and deployment. We provide task-specific guidance that clarifies which steps are required for different analytical objectives. SaML provides a checklist for valid population inference from survey data.

📄 PDF Abstract BibTeX arXiv:2605.08963

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Survey of Guidelines and Best Practices for the Generation, Interlinking, Publication, and Validation of Linguistic Linked Data

2022-06-01 · LDL (ACL) 2022 6 · Fahad Khan, Christian Chiarcos, Thierry Declerck, Maria Pia di Buono 외

This article discusses a survey carried out within the NexusLinguarum COST Action which aimed to give an overview of existing guidelines (GLs) and best practices (BPs) in linguistic linked data. In particular it focused …

Survey

Towards Equalised Odds as Fairness Metric in Academic Performance Prediction

2022-09-29 · Jannik Dunkelau, Manh Khoi Duong

The literature for fairness-aware machine learning knows a plethora of different fairness notions. It is however wellknown, that it is impossible to satisfy all of them, as certain notions contradict each other. In this …

Fairness

Toward Data-Driven Glare Classification and Prediction for Marine Megafauna Survey

2023-03-03 · Joshua Power, Derek Jacoby, Marc-Antoine Drouin, Guillaume Durand 외

Critically endangered species in Canadian North Atlantic waters are systematically surveyed to estimate species populations which influence governing policies. Due to its impact on policy, population accuracy is importan…

Entity Aware Modelling: A Survey

2023-02-16 · Rahul Ghosh, HaoYu Yang, Ankush Khandelwal, Erhu He 외

Personalized prediction of responses for individual entities caused by external drivers is vital across many disciplines. Recent machine learning (ML) advances have led to new state-of-the-art response prediction models.…

FairnessPredictionSurveyUncertainty Quantification

On Context Span Needed for Machine Translation Evaluation

2020-05-01 · LREC 2020 5 · Sheila Castilho, Maja Popovi{\'c}, Andy Way

Despite increasing efforts to improve evaluation of machine translation (MT) by going beyond the sentence level to the document level, the definition of what exactly constitutes a {``}document level{''} is still not clea…

Machine TranslationSentenceTranslation