Deep Feature Synthesis: Towards Automating Data Science Endeavors
In this paper, we develop the Data Science Machine, which is able to derive predictive models from raw data automatically. To achieve this automation, we first propose and develop the Deep Feature Synthesis algorithm for automatically generating features for relational datasets. The algorithm follows relationships in the data to a base field, and then sequentially applies mathematical functions along that path to create the final feature. Second, we implement a generalizable machine learning pipeline and tune it using a novel Gaussian Copula process based approach. We entered the Data Science Machine in 3 data science competitions that featured 906 other data science teams. Our approach beats 615 teams in these data science competitions. In 2 of the 3 competitions we beat a majority of competitors, and in the third, we achieved 94% of the best competitor's score. In the best case, with an ongoing competition, we beat 85.6% of the teams and achieved 95.7% of the top submissions score.
Code (1)
Tasks
Automated Feature EngineeringSimilar Papers 제목 키워드 기반
An Autonomous Large Language Model Agent for Chemical Literature Data Mining
Chemical synthesis, which is crucial for advancing material synthesis and drug discovery, impacts various sectors including environmental science and healthcare. The rise of technology in chemistry has generated extensiv…
AI AgentDrug DiscoveryLanguage ModelingLanguage Modelling+2Considerations of automated machine learning in clinical metabolic profiling: Altered homocysteine plasma concentration associated with metformin exposure
With the maturation of metabolomics science and proliferation of biobanks, clinical metabolic profiling is an increasingly opportunistic frontier for advancing translational clinical research. Automated Machine Learning …
AutoMLBIG-bench Machine Learningfeature selectionAutomating biomedical data science through tree-based pipeline optimization
Over the past decade, data science and machine learning has grown from a mysterious art form to a staple tool across a variety of fields in academia, business, and government. In this paper, we introduce the concept of t…
BIG-bench Machine LearningGeneral ClassificationHyperparameter OptimizationHuman-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI
The rapid advancement of artificial intelligence (AI) is changing our lives in many ways. One application domain is data science. New techniques in automating the creation of AI, known as AutoAI or AutoML, aim to automat…
AutoMLA Review on Scientific Knowledge Extraction using Large Language Models in Biomedical Sciences
The rapid advancement of large language models (LLMs) has opened new boundaries in the extraction and synthesis of medical knowledge, particularly within evidence synthesis. This paper reviews the state-of-the-art applic…
RAGRetrieval-augmented Generation