Extracting Molecular Properties from Natural Language with Multimodal Contrastive Learning
Deep learning in computational biochemistry has traditionally focused on molecular graphs neural representations; however, recent advances in language models highlight how much scientific knowledge is encoded in text. To bridge these two modalities, we investigate how molecular property information can be transferred from natural language to graph representations. We study property prediction performance gains after using contrastive learning to align neural graph representations with representations of textual descriptions of their characteristics. We implement neural relevance scoring strategies to improve text retrieval, introduce a novel chemically-valid molecular graph augmentation strategy inspired by organic reactions, and demonstrate improved performance on downstream MoleculeNet property classification tasks. We achieve a +4.26% AUROC gain versus models pre-trained on the graph modality alone, and a +1.54% gain compared to recently proposed molecular graph/text contrastively trained MoMu model (Su et al. 2022).
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningProperty PredictionRetrievalText RetrievalvalidMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
XMolCap: Advancing Molecular Captioning through Multimodal Fusion and Explainable Graph Neural Networks
Large language models (LLMs) have significantly advanced computational biology by enabling the integration of molecular, protein, and natural language data to accelerate drug discovery. However, existing molecular captio…
Drug DiscoveryMolecule CaptioningInstruction Multi-Constraint Molecular Generation Using a Teacher-Student Large Language Model
While various models and computational tools have been proposed for structure and property analysis of molecules, generating molecules that conform to all desired structures and properties remains a challenge. Here, we i…
Drug DiscoveryKnowledge DistillationLanguage ModelingLanguage Modelling+1Integrating Chemical Language and Molecular Graph in Multimodal Fused Deep Learning for Drug Property Prediction
Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, …
Deep LearningDrug DiscoveryMolecular Property Predictionmolecular representation+2LLM and GNN are Complementary: Distilling LLM for Multimodal Graph Learning
Recent progress in Graph Neural Networks (GNNs) has greatly enhanced the ability to model complex molecular structures for predicting properties. Nevertheless, molecular data encompasses more than just graph structures, …
Graph LearningLanguage ModelingLanguage ModellingLarge Language ModelProperty Enhanced Instruction Tuning for Multi-task Molecule Generation with Large Language Models
Large language models (LLMs) are widely applied in various natural language processing tasks such as question answering and machine translation. However, due to the lack of labeled data and the difficulty of manual annot…
Machine TranslationMolecular Property PredictionMolecule CaptioningProperty Prediction+1