paper-with-me

Papers

From Words to Molecules: A Survey of Large Language Models in Chemistry

2024-02-02 · Chang Liao, Yemin Yu, Yu Mei, Ying WEI

In recent years, Large Language Models (LLMs) have achieved significant success in natural language processing (NLP) and various interdisciplinary areas. However, applying LLMs to chemistry is a complex task that requires specialized domain knowledge. This paper provides a thorough exploration of the nuanced methodologies employed in integrating LLMs into the field of chemistry, delving into the complexities and innovations at this interdisciplinary juncture. Specifically, our analysis begins with examining how molecular information is fed into LLMs through various representation and tokenization methods. We then categorize chemical LLMs into three distinct groups based on the domain and modality of their input data, and discuss approaches for integrating these inputs for LLMs. Furthermore, this paper delves into the pretraining objectives with adaptations to chemical LLMs. After that, we explore the diverse applications of LLMs in chemistry, including novel paradigms for their application in chemistry tasks. Finally, we identify promising research directions, including further integration with chemical knowledge, advancements in continual learning, and improvements in model interpretability, paving the way for groundbreaking developments in the field.

📄 PDF Abstract BibTeX arXiv:2402.01439

Code (0)

등록된 구현이 없습니다.

Tasks

Continual Learning

Similar Papers 제목 키워드 기반

Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Survey

2024-03-03 · Qizhi Pei, Lijun Wu, Kaiyuan Gao, Jinhua Zhu 외

The integration of biomolecular modeling with natural language (BL) has emerged as a promising interdisciplinary area at the intersection of artificial intelligence, chemistry and biology. This approach leverages the ric…

Property Prediction

From Generalist to Specialist: A Survey of Large Language Models for Chemistry

2024-12-28 · Yang Han, Ziping Wan, Lu Chen, Kai Yu 외

Large Language Models (LLMs) have significantly transformed our daily life and established a new paradigm in natural language processing (NLP). However, the predominant pretraining of LLMs on extensive web-based texts re…

scientific discoverySurvey

Chemistry-informed Macromolecule Graph Representation for Similarity Computation and Supervised Learning

2021-03-08 · ICLR Workshop GTRL 2021 5 · Somesh Mohapatra, Joyce An, Rafael Gomez-Bombarelli

Macromolecules are large, complex molecules composed of covalently bonded monomer units, existing in different stereochemical configurations and topologies. As a result of such chemical diversity, representing, comparing…

Decision MakingDiversity

Chemlambda, universality and self-multiplication

2014-03-31 · Marius Buliga, Louis H. Kauffman

We present chemlambda (or the chemical concrete machine), an artificial chemistry with the following properties: (a) is Turing complete, (b) has a model of decentralized, distributed computing associated to it, (c) works…

Artificial LifeDistributed Computing

Exploring Data-Driven Chemical SMILES Tokenization Approaches to Identify Key Protein-Ligand Binding Moieties

2022-10-26 · Asu Büşra Temizer, Gökçe Uludoğan, Rıza Özçelik, Taha Koulani 외

Machine learning models have found numerous successful applications in computational drug discovery. A large body of these models represents molecules as sequences since molecular sequences are easily available, simple, …

Drug DesignDrug DiscoveryProperty Prediction