paper-with-me

홈 › Papers

Text-Augmented Multimodal LLMs for Chemical Reaction Condition Recommendation

2024-07-21 · Yu Zhang, Ruijie Yu, Kaipeng Zeng, Ding Li, Feng Zhu, Xiaokang Yang, Yaohui Jin, Yanyan Xu

High-throughput reaction condition (RC) screening is fundamental to chemical synthesis. However, current RC screening suffers from laborious and costly trial-and-error workflows. Traditional computer-aided synthesis planning (CASP) tools fail to find suitable RCs due to data sparsity and inadequate reaction representations. Nowadays, large language models (LLMs) are capable of tackling chemistry-related problems, such as molecule design, and chemical logic Q\&A tasks. However, LLMs have not yet achieved accurate predictions of chemical reaction conditions. Here, we present MM-RCR, a text-augmented multimodal LLM that learns a unified reaction representation from SMILES, reaction graphs, and textual corpus for chemical reaction recommendation (RCR). To train MM-RCR, we construct 1.2 million pair-wised Q\&A instruction datasets. Our experimental results demonstrate that MM-RCR achieves state-of-the-art performance on two open benchmark datasets and exhibits strong generalization capabilities on out-of-domain (OOD) and High-Throughput Experimentation (HTE) datasets. MM-RCR has the potential to accelerate high-throughput condition screening in chemical synthesis.

📄 PDF Abstract BibTeX arXiv:2407.15141

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

RxnBench: A Multimodal Benchmark for Evaluating Large Language Models on Chemical Reaction Understanding from Scientific Literature

2025-12-29 · Hanzheng Li, Xi Fang, Yixuan Li, Chaozheng Huang 외 arxiv

The integration of Multimodal Large Language Models (MLLMs) into chemistry promises to revolutionize scientific discovery, yet their ability to comprehend the dense, graphical language of reactions within authentic liter…

Multimodal Search in Chemical Documents and Reactions

2025-02-24 · Ayush Kumar Shah, Abhisek Dey, Leo Luo, Bryan Amador 외

We present a multimodal search tool that facilitates retrieval of chemical reactions, molecular structures, and associated text from scientific literature. Queries may combine molecular diagrams, textual descriptions, an…

Retrieval

ChemVLM: Exploring the Power of Multimodal Large Language Models in Chemistry Area

2024-08-14 · Junxian Li, Di Zhang, Xunzhi Wang, Zeying Hao 외

Large Language Models (LLMs) have achieved remarkable success and have been applied across various scientific fields, including chemistry. However, many chemical tasks require the processing of visual information, which …

Language ModelingLanguage ModellingLarge Language ModelMultimodal Large Language Model+3

PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes

2024-06-19 · He Cao, Yanjun Shao, Zhiyuan Liu, Zijing Liu 외

Multimodal Large Language Models (MLLMs) have seen growing adoption across various scientific disciplines. These advancements encourage the investigation of molecule-text modeling within synthetic chemistry, a field dedi…

cross-modal alignment

A Multi-Agent System Enables Versatile Information Extraction from the Chemical Literature

2025-07-27 · Yufan Chen, Ching Ting Leung, Bowen Yu, Jianwei Sun 외 arxiv

To fully expedite AI-powered chemical research, high-quality chemical databases are the foundation. Automatic extraction of chemical information from the literature is essential for constructing reaction databases, but i…

Information Extraction