3M-Diffusion: Latent Multi-Modal Diffusion for Language-Guided Molecular Structure Generation
Generating molecular structures with desired properties is a critical task with broad applications in drug discovery and materials design. We propose 3M-Diffusion, a novel multi-modal molecular graph generation method, to generate diverse, ideally novel molecular structures with desired properties. 3M-Diffusion encodes molecular graphs into a graph latent space which it then aligns with the text space learned by encoder-based LLMs from textual descriptions. It then reconstructs the molecular structure and atomic attributes based on the given text descriptions using the molecule decoder. It then learns a probabilistic mapping from the text space to the latent molecular graph space using a diffusion model. The results of our extensive experiments on several datasets demonstrate that 3M-Diffusion can generate high-quality, novel and diverse molecular graphs that semantically match the textual description provided.
Code (1)
Tasks
DecoderDrug DiscoveryGraph GenerationMolecular Graph Generationtext-guided-generationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Latent Diffusion for Language Generation
Diffusion models have achieved great success in modeling continuous data modalities such as images, audio, and video, but have seen limited use in discrete domains such as language. Recent attempts to adapt diffusion to …
DecoderText GenerationMultimodal Latent Language Modeling with Next-Token Diffusion
Multimodal generative models require a unified approach to handle both discrete data (e.g., text and code) and continuous data (e.g., image, audio, video). In this work, we propose Latent Language Modeling (LatentLM), wh…
Image GenerationLanguage ModelingLanguage Modellingmultimodal generation+4Coevolutionary Continuous Discrete Diffusion: Make Your Diffusion Language Model a Latent Reasoner
Diffusion language models, especially masked discrete diffusion models, have achieved great success recently. While there are some theoretical and primary empirical results showing the advantages of latent reasoning with…
CoLa-Diff: Conditional Latent Diffusion Model for Multi-Modal MRI Synthesis
MRI synthesis promises to mitigate the challenge of missing MRI modality in clinical practice. Diffusion model has emerged as an effective technique for image synthesis by modelling complex and variable data distribution…
CoLAImage GenerationUnified Multi-Modal Latent Diffusion for Joint Subject and Text Conditional Image Generation
Language-guided image generation has achieved great success nowadays by using diffusion models. However, texts can be less detailed to describe highly-specific subjects such as a particular dog or a certain car, which ma…
Conditional Image GenerationImage GenerationText to Image GenerationText-to-Image Generation