paper-with-me

Papers

Learning Joint 2D & 3D Diffusion Models for Complete Molecule Generation

2023-05-21 · Han Huang, Leilei Sun, Bowen Du, Weifeng Lv

Designing new molecules is essential for drug discovery and material science. Recently, deep generative models that aim to model molecule distribution have made promising progress in narrowing down the chemical research space and generating high-fidelity molecules. However, current generative models only focus on modeling either 2D bonding graphs or 3D geometries, which are two complementary descriptors for molecules. The lack of ability to jointly model both limits the improvement of generation quality and further downstream applications. In this paper, we propose a new joint 2D and 3D diffusion model (JODO) that generates complete molecules with atom types, formal charges, bond information, and 3D coordinates. To capture the correlation between molecular graphs and geometries in the diffusion process, we develop a Diffusion Graph Transformer to parameterize the data prediction model that recovers the original data from noisy data. The Diffusion Graph Transformer interacts node and edge representations based on our relational attention mechanism, while simultaneously propagating and updating scalar features and geometric vectors. Our model can also be extended for inverse molecular design targeting single or multiple quantum properties. In our comprehensive evaluation pipeline for unconditional joint generation, the results of the experiment show that JODO remarkably outperforms the baselines on the QM9 and GEOM-Drugs datasets. Furthermore, our model excels in few-step fast sampling, as well as in inverse molecule design and molecular graph generation. Our code is provided in https://github.com/GRAPH-0/JODO.

📄 PDF Abstract BibTeX arXiv:2305.12347

Code (2)

graph-0/jodo 공식 구현 pytorch
graph-0/cdgs pytorch

Tasks

3D Molecule GenerationDrug DiscoveryGraph GenerationMolecular Graph Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
LapEigen 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Geometry-Complete Diffusion for 3D Molecule Generation and Optimization

2023-02-08 · Alex Morehead, Jianlin Cheng

Denoising diffusion probabilistic models (DDPMs) have pioneered new state-of-the-art results in disciplines such as computer vision and computational biology for diverse tasks ranging from text-guided image generation to…

3D Molecule GenerationDenoisingGraph GenerationImage Generation+5

MUDiff: Unified Diffusion for Complete Molecule Generation

2023-04-28 · Chenqing Hua, Sitao Luan, Minkai Xu, Rex Ying 외

Molecule generation is a very important practical problem, with uses in drug discovery and material design, and AI methods promise to provide useful solutions. However, existing methods for molecule generation focus eith…

3D geometryDrug Discoveryvalid

Equivariant Diffusion for Molecule Generation in 3D

2022-03-31 · Emiel Hoogeboom, Victor Garcia Satorras, Clément Vignac, Max Welling

This work introduces a diffusion model for molecule generation in 3D that is equivariant to Euclidean transformations. Our E(3) Equivariant Diffusion Model (EDM) learns to denoise a diffusion process with an equivariant …

Unconditional Molecule Generation

Coarse-to-Fine: a Hierarchical Diffusion Model for Molecule Generation in 3D

2023-05-05 · Bo Qiang, Yuxuan Song, Minkai Xu, Jingjing Gong 외

Generating desirable molecular structures in 3D is a fundamental problem for drug discovery. Despite the considerable progress we have achieved, existing methods usually generate molecules in atom resolution and ignore i…

Drug Discovery

Towards Joint Sequence-Structure Generation of Nucleic Acid and Protein Complexes with SE(3)-Discrete Diffusion

2023-12-21 · Alex Morehead, Jeffrey Ruffolo, Aadyot Bhatnagar, Ali Madani

Generative models of macromolecules carry abundant and impactful implications for industrial and biomedical efforts in protein engineering. However, existing methods are currently limited to modeling protein structures o…