paper-with-me

홈 › Papers

Data Cleaning and Machine Learning: A Systematic Literature Review

2023-10-03 · Pierre-Olivier Côté, Amin Nikanjam, Nafisa Ahmed, Dmytro Humeniuk, Foutse khomh

Context: Machine Learning (ML) is integrated into a growing number of systems for various applications. Because the performance of an ML model is highly dependent on the quality of the data it has been trained on, there is a growing interest in approaches to detect and repair data errors (i.e., data cleaning). Researchers are also exploring how ML can be used for data cleaning; hence creating a dual relationship between ML and data cleaning. To the best of our knowledge, there is no study that comprehensively reviews this relationship. Objective: This paper's objectives are twofold. First, it aims to summarize the latest approaches for data cleaning for ML and ML for data cleaning. Second, it provides future work recommendations. Method: We conduct a systematic literature review of the papers published between 2016 and 2022 inclusively. We identify different types of data cleaning activities with and for ML: feature cleaning, label cleaning, entity matching, outlier detection, imputation, and holistic data cleaning. Results: We summarize the content of 101 papers covering various data cleaning activities and provide 24 future work recommendations. Our review highlights many promising data cleaning techniques that can be further extended. Conclusion: We believe that our review of the literature will help the community develop better approaches to clean data.

📄 PDF Abstract BibTeX arXiv:2310.01765

Code (1)

poclecoqq/slr-datacleaning 공식 구현

Tasks

ImputationOutlier DetectionSystematic Literature Review

Similar Papers 제목 키워드 기반

CleanML: A Study for Evaluating the Impact of Data Cleaning on ML Classification Tasks

2019-04-20 · Peng Li, Xi Rao, Jennifer Blase, Yue Zhang 외

Data quality affects machine learning (ML) model performances, and data scientists spend considerable amount of time on data cleaning before model training. However, to date, there does not exist a rigorous study on how …

General ClassificationTwo-sample testing

CleanPatrick: A Benchmark for Image Data Cleaning

2025-05-16 · Fabian Gröger, Simone Lionetti, Philippe Gottfrois, Alvaro Gonzalez-Jimenez 외

Robust machine learning depends on clean data, yet current image data cleaning benchmarks rely on synthetic noise or narrow human studies, limiting comparison and real-world relevance. We introduce CleanPatrick, the firs…

BenchmarkingLabel Error DetectionSSIM

A Systematic Review of Data-to-Text NLG

2024-02-13 · Chinonso Cynthia Osuji, Thiago castro Ferreira, Brian Davis

This systematic review undertakes a comprehensive analysis of current research on data-to-text generation, identifying gaps, challenges, and future directions within the field. Relevant literature in this field on datase…

Data-to-Text GenerationHallucinationRe-RankingText Generation

Technical Report on classification of literature related to children speech disorder

2025-05-20 · Ziang Wang, Amir Aryani

This technical report presents a natural language processing (NLP)-based approach for systematically classifying scientific literature on childhood speech disorders. We retrieved and filtered 4,804 relevant articles publ…

Articles

Preliminary Systematic Literature Review of Machine Learning System Development Process

2019-10-12 · Yasuhiro Watanabe, Hironori Washizaki, Kazunori Sakamoto, Daisuke Saito 외

Previous machine learning (ML) system development research suggests that emerging software quality attributes are a concern due to the probabilistic behavior of ML systems. Assuming that detailed development processes de…

BIG-bench Machine LearningSystematic Literature Review