Automated data processing and feature engineering for deep learning and big data applications: a survey
Modern approach to artificial intelligence (AI) aims to design algorithms that learn directly from data. This approach has achieved impressive results and has contributed significantly to the progress of AI, particularly in the sphere of supervised deep learning. It has also simplified the design of machine learning systems as the learning process is highly automated. However, not all data processing tasks in conventional deep learning pipelines have been automated. In most cases data has to be manually collected, preprocessed and further extended through data augmentation before they can be effective for training. Recently, special techniques for automating these tasks have emerged. The automation of data processing tasks is driven by the need to utilize large volumes of complex, heterogeneous data for machine learning and big data applications. Today, end-to-end automated data processing systems based on automated machine learning (AutoML) techniques are capable of taking raw data and transforming them into useful features for Big Data tasks by automating all intermediate processing stages. In this work, we present a thorough review of approaches for automating data processing tasks in deep learning pipelines, including automated data preprocessing--e.g., data cleaning, labeling, missing data imputation, and categorical data encoding--as well as data augmentation (including synthetic data generation using generative AI methods) and feature engineering--specifically, automated feature extraction, feature construction and feature selection. In addition to automating specific data processing tasks, we discuss the use of AutoML methods and tools to simultaneously optimize all stages of the machine learning pipeline.
Code (0)
등록된 구현이 없습니다.
Tasks
AutoMLData AugmentationFeature Engineeringfeature selectionImputationSynthetic Data GenerationSimilar Papers 제목 키워드 기반
Catch: Collaborative Feature Set Search for Automated Feature Engineering
Feature engineering often plays a crucial role in building mining systems for tabular data, which traditionally requires experienced human experts to perform. Thanks to the rapid advances in reinforcement learning, it ha…
Automated Feature EngineeringDecision MakingFeature Engineeringreinforcement-learning+1EvoAAA: An evolutionary methodology for automated \neural autoencoder architecture search
Machine learning models work better when curated features are provided to them. Feature engineering methods have been usually used as a preprocessing step to obtain or build a proper feature set. In late years, autoencod…
Feature EngineeringRepresentation LearningLearned Feature Importance Scores for Automated Feature Engineering
Feature engineering has demonstrated substantial utility for many machine learning workflows, such as in the small data regime or when distribution shifts are severe. Thus automating this capability can relieve much manu…
Automated Feature EngineeringFeature EngineeringFeature ImportanceTime SeriesTabPrep: Closing the Feature Engineering Gap in Tabular Benchmarks
Progress in tabular machine learning has largely focused on increasingly sophisticated model architectures. At the same time, feature engineering remains a critical yet underexplored component of real-world modeling pipe…
Feature EngineeringAutomating Feature Engineering
Feature Engineering is the task of transforming the feature space in a given learning problem to improve the performance of a trained model. It is a crucial but time intensive and skillful process, involving a data scien…
Automated Feature EngineeringFeature Engineering