paper-with-me

Papers

MUDiff: Unified Diffusion for Complete Molecule Generation

2023-04-28 · Chenqing Hua, Sitao Luan, Minkai Xu, Rex Ying, Jie Fu, Stefano Ermon, Doina Precup

Molecule generation is a very important practical problem, with uses in drug discovery and material design, and AI methods promise to provide useful solutions. However, existing methods for molecule generation focus either on 2D graph structure or on 3D geometric structure, which is not sufficient to represent a complete molecule as 2D graph captures mainly topology while 3D geometry captures mainly spatial atom arrangements. Combining these representations is essential to better represent a molecule. In this paper, we present a new model for generating a comprehensive representation of molecules, including atom features, 2D discrete molecule structures, and 3D continuous molecule coordinates, by combining discrete and continuous diffusion processes. The use of diffusion processes allows for capturing the probabilistic nature of molecular processes and exploring the effect of different factors on molecular structures. Additionally, we propose a novel graph transformer architecture to denoise the diffusion process. The transformer adheres to 3D roto-translation equivariance constraints, allowing it to learn invariant atom and edge representations while preserving the equivariance of atom coordinates. This transformer can be used to learn molecular representations robust to geometric transformations. We evaluate the performance of our model through experiments and comparisons with existing methods, showing its ability to generate more stable and valid molecules. Our model is a promising approach for designing stable and diverse molecules and can be applied to a wide range of tasks in molecular modeling.

📄 PDF Abstract BibTeX arXiv:2304.14621

Code (0)

등록된 구현이 없습니다.

Tasks

3D geometryDrug Discoveryvalid

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

IMUDiffusion: A Diffusion Model for Multivariate Time Series Synthetisation for Inertial Motion Capturing Systems

2024-11-05 · Heiko Oppel, Michael Munz

Kinematic sensors are often used to analyze movement behaviors in sports and daily activities due to their ease of use and lack of spatial restrictions, unlike video-based motion capturing systems. Still, the generation,…

DiversityTime SeriesTime Series Generation

Geometry-Complete Diffusion for 3D Molecule Generation and Optimization

2023-02-08 · Alex Morehead, Jianlin Cheng

Denoising diffusion probabilistic models (DDPMs) have pioneered new state-of-the-art results in disciplines such as computer vision and computational biology for diverse tasks ranging from text-guided image generation to…

3D Molecule GenerationDenoisingGraph GenerationImage Generation+5

Learning Joint 2D & 3D Diffusion Models for Complete Molecule Generation

2023-05-21 · Han Huang, Leilei Sun, Bowen Du, Weifeng Lv

Designing new molecules is essential for drug discovery and material science. Recently, deep generative models that aim to model molecule distribution have made promising progress in narrowing down the chemical research …

3D Molecule GenerationDrug DiscoveryGraph GenerationMolecular Graph Generation

Towards Unified Latent Space for 3D Molecular Latent Diffusion Modeling

2025-03-19 · Yanchen Luo, Zhiyuan Liu, Yi Zhao, Sihang Li 외

3D molecule generation is crucial for drug discovery and material science, requiring models to process complex multi-modalities, including atom types, chemical bonds, and 3D coordinates. A key challenge is integrating th…

3D Molecule GenerationDrug DiscoveryInductive Bias

UniGenX: Unified Generation of Sequence and Structure with Autoregressive Diffusion

2025-03-09 · Gongbo Zhang, Yanting Li, Renqian Luo, Pipi Hu 외

Unified generation of sequence and structure for scientific data (e.g., materials, molecules, proteins) is a critical task. Existing approaches primarily rely on either autoregressive sequence models or diffusion models,…

Text Generation