paper-with-me

Papers

Data-driven Discovery with Large Generative Models

2024-02-21 · Bodhisattwa Prasad Majumder, Harshit Surana, Dhruv Agarwal, Sanchaita Hazra, Ashish Sabharwal, Peter Clark

With the accumulation of data at an unprecedented rate, its potential to fuel scientific discovery is growing exponentially. This position paper urges the Machine Learning (ML) community to exploit the capabilities of large generative models (LGMs) to develop automated systems for end-to-end data-driven discovery -- a paradigm encompassing the search and verification of hypotheses purely from a set of provided datasets, without the need for additional data collection or physical experiments. We first outline several desiderata for an ideal data-driven discovery system. Then, through DATAVOYAGER, a proof-of-concept utilizing GPT-4, we demonstrate how LGMs fulfill several of these desiderata -- a feat previously unattainable -- while also highlighting important limitations in the current system that open up opportunities for novel ML research. We contend that achieving accurate, reliable, and robust end-to-end discovery systems solely through the current capabilities of LGMs is challenging. We instead advocate for fail-proof tool integration, along with active user moderation through feedback mechanisms, to foster data-driven scientific discoveries with efficiency and reproducibility.

📄 PDF Abstract BibTeX arXiv:2402.13610

Code (0)

등록된 구현이 없습니다.

Tasks

scientific discovery

Methods 이 논문이 사용한 방법론

Attention 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Visualizing Deep Graph Generative Models for Drug Discovery

2020-07-20 · Karan Yang, Chengxi Zang, Fei Wang

Drug discovery aims at designing novel molecules with specific desired properties for clinical trials. Over past decades, drug discovery and development have been a costly and time consuming process. Driven by big chemic…

Drug Discovery

The Future of Fundamental Science Led by Generative Closed-Loop Artificial Intelligence

2023-07-09 · Hector Zenil, Jesper Tegnér, Felipe S. Abrahão, Alexander Lavin 외

Recent advances in machine learning and AI, including Generative AI and LLMs, are disrupting technological innovation, product development, and society as a whole. AI's contribution to technology can come from multiple a…

Model Discoveryscientific discovery

Artificial Intelligence and Generative Models for Materials Discovery -- A Review

2025-08-05 · Albertus Denny Handoko, Riko I Made arxiv

High throughput experimentation tools, machine learning (ML) methods, and open material databases are radically changing the way new materials are discovered. From the experimentally driven approach in the past, we are m…

Data-Driven Discovery of Interpretable Kalman Filter Variants through Large Language Models and Genetic Programming

2025-08-13 · Vasileios Saketos, Sebastian Kaltenbach, Sergey Litvinov, Petros Koumoutsakos arxiv

Algorithmic discovery has traditionally relied on human ingenuity and extensive experimentation. Here we investigate whether a prominent scientific computing algorithm, the Kalman Filter, can be discovered through an aut…

Towards Scientific Discovery with Generative AI: Progress, Opportunities, and Challenges

2024-12-16 · Chandan K Reddy, Parshin Shojaee

Scientific discovery is a complex cognitive process that has driven human knowledge and technological progress for centuries. While artificial intelligence (AI) has made significant advances in automating aspects of scie…

Automated Theorem Provingscientific discovery