paper-with-me

홈 › Papers

The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4

2023-11-13 · Microsoft Research AI4Science, Microsoft Azure Quantum

In recent years, groundbreaking advancements in natural language processing have culminated in the emergence of powerful large language models (LLMs), which have showcased remarkable capabilities across a vast array of domains, including the understanding, generation, and translation of natural language, and even tasks that extend beyond language processing. In this report, we delve into the performance of LLMs within the context of scientific discovery, focusing on GPT-4, the state-of-the-art language model. Our investigation spans a diverse range of scientific areas encompassing drug discovery, biology, computational chemistry (density functional theory (DFT) and molecular dynamics (MD)), materials design, and partial differential equations (PDE). Evaluating GPT-4 on scientific tasks is crucial for uncovering its potential across various research domains, validating its domain-specific expertise, accelerating scientific progress, optimizing resource allocation, guiding future model development, and fostering interdisciplinary research. Our exploration methodology primarily consists of expert-driven case assessments, which offer qualitative insights into the model's comprehension of intricate scientific concepts and relationships, and occasionally benchmark testing, which quantitatively evaluates the model's capacity to solve well-defined domain-specific problems. Our preliminary exploration indicates that GPT-4 exhibits promising potential for a variety of scientific applications, demonstrating its aptitude for handling complex problem-solving and knowledge integration tasks. Broadly speaking, we evaluate GPT-4's knowledge base, scientific understanding, scientific numerical calculation abilities, and various scientific prediction capabilities.

📄 PDF Abstract BibTeX arXiv:2311.07361

Code (0)

등록된 구현이 없습니다.

Tasks

Computational chemistryDrug DiscoveryLanguage Modellingscientific discovery

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음

Similar Papers 제목 키워드 기반

AI Can Learn Scientific Taste

2026-03-15 · Jingqi Tong, Mingzhe Li, Hangcheng Li, Yongzhuo Yang 외 arxiv

Scientific discovery depends on expert judgement and foresight, which we call scientific taste: the ability to judge and propose research ideas with the potential for long-term scientific impact. Scientific taste is larg…

Reinforcement Learning

Knowledge Discovery in COVID-19 Research Literature

2021-09-01 · RANLP 2021 9 · Alejandro Piad-Morffis, Suilan Estevez-Velarde, Ernesto Luis Estevanell-Valladares, Yoan Gutiérrez 외

This paper presents the preliminary results of an ongoing project that analyzes the growing body of scientific research published around the COVID-19 pandemic. In this research, a general-purpose semantic model is used t…

Towards Large-Scale Exploratory Search over Heterogeneous Sources

2018-11-15 · Mariia Seleznova, Anton Belyy, Aleksei Sholokhov

Since time immemorial, people have been looking for ways to organize scientific knowledge into some systems to facilitate search and discovery of new ideas. The problem was partially solved in the pre-Internet era using …

Diversity

FIRE-Bench: Evaluating Agents on the Rediscovery of Scientific Insights

2026-02-02 · Zhen Wang, Fan Bai, Zhongyan Luo, Jinyan Su 외 arxiv

Autonomous agents powered by large language models (LLMs) promise to accelerate scientific discovery end-to-end, but rigorously evaluating their capacity for verifiable discovery remains a central challenge. Existing ben…

Accelerating Material Design with the Generative Toolkit for Scientific Discovery

2022-07-08 · Matteo Manica, Jannis Born, Joris Cadow, Dimitrios Christofidellis 외

With the growing availability of data within various scientific domains, generative models hold enormous potential to accelerate scientific discovery. They harness powerful representations learned from datasets to speed …

Drug DiscoveryMaterials Screeningscientific discovery