MolecularGPT: Open Large Language Model (LLM) for Few-Shot Molecular Property Prediction

2024-06-18 · Yuyan Liu, Sirui Ding, Sheng Zhou, Wenqi Fan, Qiaoyu Tan

Molecular property prediction (MPP) is a fundamental and crucial task in drug discovery. However, prior methods are limited by the requirement for a large number of labeled molecules and their restricted ability to generalize for unseen and new tasks, both of which are essential for real-world applications. To address these challenges, we present MolecularGPT for few-shot MPP. From a perspective on instruction tuning, we fine-tune large language models (LLMs) based on curated molecular instructions spanning over 1000 property prediction tasks. This enables building a versatile and specialized LLM that can be adapted to novel MPP tasks without any fine-tuning through zero- and few-shot in-context learning (ICL). MolecularGPT exhibits competitive in-context reasoning capabilities across 10 downstream evaluation datasets, setting new benchmarks for few-shot molecular prediction tasks. More importantly, with just two-shot examples, MolecularGPT can outperform standard supervised graph neural network methods on 4 out of 7 datasets. It also excels state-of-the-art LLM baselines by up to 15.7% increase on classification accuracy and decrease of 17.9 on regression metrics (e.g., RMSE) under zero-shot. This study demonstrates the potential of LLMs as effective few-shot molecular property predictors. The code is available at https://github.com/NYUSHCS/MolecularGPT.

📄 PDF Abstract BibTeX arXiv:2406.12950

Code (1)

nyushcs/moleculargpt 공식 구현 pytorch

Tasks

Drug Discovery Graph Neural NetworkIn-Context LearningLanguage ModelingLanguage ModellingLarge Language ModelMolecular Property PredictionProperty Prediction

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

DrugLLM: Open Large Language Model for Few-shot Molecule Generation

2024-05-07 · Xianggen Liu, Yan Guo, Haoran Li, Jin Liu 외

Large Language Models (LLMs) have made great strides in areas such as language processing and computer vision. Despite the emergence of diverse techniques to improve few-shot learning capacity, current LLMs fall short in…

Drug Design Drug Discovery Few-Shot Learning Language Modeling+3

In-Context Learning for Few-Shot Molecular Property Prediction

2023-10-13 · Christopher Fifty, Jure Leskovec, Sebastian Thrun

In-context learning has become an important approach for few-shot learning in Large Language Models because of its ability to rapidly adapt to new tasks without fine-tuning model parameters. However, it is restricted to …

Few-Shot Learning In-Context Learning Meta-Learning Molecular Property Prediction+2

Many-Shot In-Context Learning for Molecular Inverse Design

2024-07-26 · Saeed Moayedpour, Alejandro Corrochano-Navarro, Faryad Sahneh, Shahriar Noroozizadeh 외

Large Language Models (LLMs) have demonstrated great performance in few-shot In-Context Learning (ICL) for a variety of generative and discriminative chemical design tasks. The newly expanded context windows of LLMs can …

In-Context Learning

MolVision: Molecular Property Prediction with Vision Language Models

2025-07-04 · Deepan Adak, Yogesh Singh Rawat, Shruti Vyas arxiv

Molecular property prediction is a fundamental task in computational chemistry with critical applications in drug discovery and materials science. While recent works have explored Large Language Models (LLMs) for this ta…

Molecular Property Prediction Drug Discovery

Implicit Geometry and Interaction Embeddings Improve Few-Shot Molecular Property Prediction

2023-02-04 · Christopher Fifty, Joseph M. Paggi, Ehsan Amid, Jure Leskovec 외

Few-shot learning is a promising approach to molecular property prediction as supervised data is often very limited. However, many important molecular properties depend on complex molecular characteristics -- such as the…

Few-Shot Learning Molecular Docking Molecular Property Prediction Multi-Task Learning+3