paper-with-me

홈 › Papers

LDMol: Text-to-Molecule Diffusion Model with Structurally Informative Latent Space

2024-05-28 · Jinho Chang, Jong Chul Ye

With the emergence of diffusion models as the frontline of generative models, many researchers have proposed molecule generation techniques with conditional diffusion models. However, the unavoidable discreteness of a molecule makes it difficult for a diffusion model to connect raw data with highly complex conditions like natural language. To address this, we present a novel latent diffusion model dubbed LDMol for text-conditioned molecule generation. LDMol comprises a molecule autoencoder that produces a learnable and structurally informative feature space, and a natural language-conditioned latent diffusion model. In particular, recognizing that multiple SMILES notations can represent the same molecule, we employ a contrastive learning strategy to extract feature space that is aware of the unique characteristics of the molecule structure. LDMol outperforms the existing baselines on the text-to-molecule generation benchmark, suggesting a potential for diffusion models can outperform autoregressive models in text data generation with a better choice of the latent domain. Furthermore, we show that LDMol can be applied to downstream tasks such as molecule-to-text retrieval and text-guided molecule editing, demonstrating its versatility as a diffusion model.

📄 PDF Abstract BibTeX arXiv:2405.17829

Code (1)

jinhojsk515/ldmol 공식 구현 pytorch

Tasks

Contrastive LearningDecoderText-based de novo Molecule GenerationText Retrieval

Methods 이 논문이 사용한 방법론

Attention 설명 없음
AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Residual Connection 설명 없음
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

BiMol-Diff: A Unified Diffusion Framework for Molecular Generation and Captioning

2026-04-27 · Aditya Hemant Shahane, Anuj Kumar Sirohi, Devansh Arora, Nitin Kumar 외 arxiv

Bridging molecular structures and natural language is essential for controllable design. Autoregressive models struggle with long-range dependencies, while standard diffusion processes apply uniform corruption across pos…

Molecule CaptioningLanguage Modelling

Diffusion-based Molecule Generation with Informative Prior Bridges

2022-09-02 · Lemeng Wu, Chengyue Gong, Xingchao Liu, Mao Ye 외

AI-based molecule generation provides a promising approach to a large area of biomedical sciences and engineering, such as antibody design, hydrolase engineering, or vaccine development. Because the molecules are governe…

3D GenerationPoint Cloud Generation

Repurformer: Transformers for Repurposing-Aware Molecule Generation

2024-07-16 · Changhun Lee, Gyumin Lee

Generating as diverse molecules as possible with desired properties is crucial for drug discovery research, which invokes many approaches based on deep generative models today. Despite recent advancements in these models…

DiversityDrug Discovery

Can LLMs Generate Diverse Molecules? Towards Alignment with Structural Diversity

2024-10-04 · Hyosoon Jang, Yunhui Jang, Jaehyung Kim, Sungsoo Ahn

Recent advancements in large language models (LLMs) have demonstrated impressive performance in molecular generation, which offers potential to accelerate drug discovery. However, the current LLMs overlook a critical req…

DiversityDrug Discovery

SALSA: Semantically-Aware Latent Space Autoencoder

2023-10-04 · Kathryn E. Kirchoff, Travis Maxfield, Alexander Tropsha, Shawn M. Gomez

In deep learning for drug discovery, chemical data are often represented as simplified molecular-input line-entry system (SMILES) sequences which allow for straightforward implementation of natural language processing me…

Drug DiscoveryGraph Similarity