paper-with-me

Papers

Deep Feature Synthesis: Towards Automating Data Science Endeavors

2015-01-01 · DSAA 2015 2015 1 · James Max Kanter, Kalyan Veeramachaneni

In this paper, we develop the Data Science Machine, which is able to derive predictive models from raw data automatically. To achieve this automation, we first propose and develop the Deep Feature Synthesis algorithm for automatically generating features for relational datasets. The algorithm follows relationships in the data to a base field, and then sequentially applies mathematical functions along that path to create the final feature. Second, we implement a generalizable machine learning pipeline and tune it using a novel Gaussian Copula process based approach. We entered the Data Science Machine in 3 data science competitions that featured 906 other data science teams. Our approach beats 615 teams in these data science competitions. In 2 of the 3 competitions we beat a majority of competitors, and in the third, we achieved 94% of the best competitor's score. In the best case, with an ongoing competition, we beat 85.6% of the teams and achieved 95.7% of the top submissions score.

📄 PDF Abstract BibTeX

Code (1)

Featuretools/featuretools-docker

Tasks

Automated Feature Engineering

Similar Papers 제목 키워드 기반

An Autonomous Large Language Model Agent for Chemical Literature Data Mining

2024-02-20 · Kexin Chen, Hanqun Cao, Junyou Li, Yuyang Du 외

Chemical synthesis, which is crucial for advancing material synthesis and drug discovery, impacts various sectors including environmental science and healthcare. The rise of technology in chemistry has generated extensiv…

AI AgentDrug DiscoveryLanguage ModelingLanguage Modelling+2

Considerations of automated machine learning in clinical metabolic profiling: Altered homocysteine plasma concentration associated with metformin exposure

2017-10-09 · Alena Orlenko, Jason H. Moore, Patryk Orzechowski, Randal S. Olson 외

With the maturation of metabolomics science and proliferation of biobanks, clinical metabolic profiling is an increasingly opportunistic frontier for advancing translational clinical research. Automated Machine Learning …

AutoMLBIG-bench Machine Learningfeature selection

Automating biomedical data science through tree-based pipeline optimization

2016-01-28 · Randal S. Olson, Ryan J. Urbanowicz, Peter C. Andrews, Nicole A. Lavender 외

Over the past decade, data science and machine learning has grown from a mysterious art form to a staple tool across a variety of fields in academia, business, and government. In this paper, we introduce the concept of t…

BIG-bench Machine LearningGeneral ClassificationHyperparameter Optimization

Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI

2019-09-05 · Dakuo Wang, Justin D. Weisz, Michael Muller, Parikshit Ram 외

The rapid advancement of artificial intelligence (AI) is changing our lives in many ways. One application domain is data science. New techniques in automating the creation of AI, known as AutoAI or AutoML, aim to automat…

AutoML

A Review on Scientific Knowledge Extraction using Large Language Models in Biomedical Sciences

2024-12-04 · Gabriel Lino Garcia, João Renato Ribeiro Manesco, Pedro Henrique Paiola, Lucas Miranda 외

The rapid advancement of large language models (LLMs) has opened new boundaries in the extraction and synthesis of medical knowledge, particularly within evidence synthesis. This paper reviews the state-of-the-art applic…

RAGRetrieval-augmented Generation