Text-Guided Molecule Generation with Diffusion Language Model
Text-guided molecule generation is a task where molecules are generated to match specific textual descriptions. Recently, most existing SMILES-based molecule generation methods rely on an autoregressive architecture. In this work, we propose the Text-Guided Molecule Generation with Diffusion Language Model (TGM-DLM), a novel approach that leverages diffusion models to address the limitations of autoregressive methods. TGM-DLM updates token embeddings within the SMILES string collectively and iteratively, using a two-phase diffusion generation process. The first phase optimizes embeddings from random noise, guided by the text description, while the second phase corrects invalid SMILES strings to form valid molecular representations. We demonstrate that TGM-DLM outperforms MolT5-Base, an autoregressive model, without the need for additional data resources. Our findings underscore the remarkable effectiveness of TGM-DLM in generating coherent and precise molecules with specific properties, opening new avenues in drug discovery and related scientific domains. Code will be released at: https://github.com/Deno-V/tgm-dlm.
Code (1)
Tasks
Drug DiscoveryLanguage ModelingLanguage ModellingmodelText-based de novo Molecule GenerationvalidMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Text-guided Diffusion Model for 3D Molecule Generation
The de novo generation of molecules with targeted properties is crucial in biology, chemistry, and drug discovery. Current generative models are limited to using single property values as conditions, struggling with comp…
3D Molecule GenerationDiversityDrug DiscoverymodelLDMol: Text-to-Molecule Diffusion Model with Structurally Informative Latent Space
With the emergence of diffusion models as the frontline of generative models, many researchers have proposed molecule generation techniques with conditional diffusion models. However, the unavoidable discreteness of a mo…
Contrastive LearningDecoderText-based de novo Molecule GenerationText RetrievalGeometry-Complete Diffusion for 3D Molecule Generation and Optimization
Denoising diffusion probabilistic models (DDPMs) have pioneered new state-of-the-art results in disciplines such as computer vision and computational biology for diverse tasks ranging from text-guided image generation to…
3D Molecule GenerationDenoisingGraph GenerationImage Generation+53M-Diffusion: Latent Multi-Modal Diffusion for Language-Guided Molecular Structure Generation
Generating molecular structures with desired properties is a critical task with broad applications in drug discovery and materials design. We propose 3M-Diffusion, a novel multi-modal molecular graph generation method, t…
DecoderDrug DiscoveryGraph GenerationMolecular Graph Generation+1Text-Guided Multi-Property Molecular Optimization with a Diffusion Language Model
Molecular optimization (MO) is a crucial stage in drug discovery in which task-oriented generated molecules are optimized to meet practical industrial requirements. Existing mainstream MO approaches primarily utilize ext…
Drug DiscoveryLanguage ModelingLanguage ModellingProperty Prediction