paper-with-me

Papers

Instruction-Based Molecular Graph Generation with Unified Text-Graph Diffusion Model

2024-08-19 · Yuran Xiang, Haiteng Zhao, Chang Ma, Zhi-Hong Deng

Recent advancements in computational chemistry have increasingly focused on synthesizing molecules based on textual instructions. Integrating graph generation with these instructions is complex, leading most current methods to use molecular sequences with pre-trained large language models. In response to this challenge, we propose a novel framework, named $\textbf{UTGDiff (Unified Text-Graph Diffusion Model)}$, which utilizes language models for discrete graph diffusion to generate molecular graphs from instructions. UTGDiff features a unified text-graph transformer as the denoising network, derived from pre-trained language models and minimally modified to process graph data through attention bias. Our experimental results demonstrate that UTGDiff consistently outperforms sequence-based baselines in tasks involving instruction-based molecule generation and editing, achieving superior performance with fewer parameters given an equivalent level of pretraining corpus. Our code is availble at https://github.com/ran1812/UTGDiff.

📄 PDF Abstract BibTeX arXiv:2408.09896

Code (1)

ran1812/utgdiff 공식 구현 pytorch

Tasks

Computational chemistryDenoisingGraph GenerationMolecular Graph Generation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

LLaMo: Large Language Model-based Molecular Graph Assistant

2024-10-31 · Jinyoung Park, Minseong Bae, Dohwan Ko, Hyunwoo J. Kim

Large Language Models (LLMs) have demonstrated remarkable generalization and instruction-following capabilities with instruction tuning. The advancements in LLMs and instruction tuning have led to the development of Larg…

Instruction FollowingIUPAC Name PredictionLanguage ModelingLanguage Modelling+4

GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Text

2023-08-14 · PengFei Liu, Yiming Ren, Jun Tao, Zhixiang Ren

Large language models have made significant strides in natural language processing, enabling innovative applications in molecular science by processing textual representations of molecules. However, most existing languag…

Drug DiscoveryImage CaptioningLanguage ModelingLanguage Modelling+5

OOD-GraphLLM: Graph Large Language Model for Out-of-Distribution Generalized Drug Synergy Prediction

2026-05-28 · Xin Wang, Linxin Xiao, Yang Yao, Wenwu Zhu arxiv

Drug synergy prediction (DSP) aims to identify efficacious drug combinations under various cellular contexts with different targets. However, the continual emergence of novel compounds results in variations in molecular …

MolTC: Towards Molecular Relational Modeling In Language Models

2024-02-06 · Junfeng Fang, Shuai Zhang, Chang Wu, Zhengyi Yang 외

Molecular Relational Learning (MRL), aiming to understand interactions between molecular pairs, plays a pivotal role in advancing biochemical research. Recently, the adoption of large language models (LLMs), known for th…

Relational Reasoning

MolSnap: Snap-Fast Molecular Generation with Latent Variational Mean Flow

2025-08-07 · Md Atik Ahamed, Qiang Ye, Qiang Cheng arxiv

Molecular generation conditioned on textual descriptions is a fundamental task in computational chemistry and drug discovery. Existing methods often struggle to simultaneously ensure high-quality, diverse generation and …

Computational EfficiencyDrug Discovery