paper-with-me

Papers

Permutation invariant graph-to-sequence model for template-free retrosynthesis and reaction prediction

2021-10-19 · Zhengkai Tu, Connor W. Coley

Synthesis planning and reaction outcome prediction are two fundamental problems in computer-aided organic chemistry for which a variety of data-driven approaches have emerged. Natural language approaches that model each problem as a SMILES-to-SMILES translation lead to a simple end-to-end formulation, reduce the need for data preprocessing, and enable the use of well-optimized machine translation model architectures. However, SMILES representations are not an efficient representation for capturing information about molecular structures, as evidenced by the success of SMILES augmentation to boost empirical performance. Here, we describe a novel Graph2SMILES model that combines the power of Transformer models for text generation with the permutation invariance of molecular graph encoders that mitigates the need for input data augmentation. As an end-to-end architecture, Graph2SMILES can be used as a drop-in replacement for the Transformer in any task involving molecule(s)-to-molecule(s) transformations. In our encoder, an attention-augmented directed message passing neural network (D-MPNN) captures local chemical environments, and the global attention encoder allows for long-range and intermolecular interactions, enhanced by graph-aware positional embedding. Graph2SMILES improves the top-1 accuracy of the Transformer baselines by $1.7\%$ and $1.9\%$ for reaction outcome prediction on USPTO_480k and USPTO_STEREO datasets respectively, and by $9.8\%$ for one-step retrosynthesis on the USPTO_50k dataset.

📄 PDF Abstract BibTeX arXiv:2110.09681

Code (1)

coleygroup/graph2smiles 공식 구현 pytorch

Tasks

Data AugmentationGraph-to-SequenceMachine TranslationRetrosynthesisSingle-step retrosynthesisText GenerationTranslation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Janossy Pooling: Learning Deep Permutation-Invariant Functions for Variable-Size Inputs

2018-11-05 · ICLR 2019 5 · Ryan L. Murphy, Balasubramaniam Srinivasan, Vinayak Rao, Bruno Ribeiro

We consider a simple and overarching representation for permutation-invariant functions of sequences (or multiset functions). Our approach, which we call Janossy pooling, expresses a permutation-invariant function as the…

Stochastic Optimization

Permutation Invariant Graph Generation via Score-Based Generative Modeling

2020-03-02 · Chenhao Niu, Yang song, Jiaming Song, Shengjia Zhao 외

Learning generative models for graph-structured data is challenging because graphs are discrete, combinatorial, and the underlying data distribution is invariant to the ordering of nodes. However, most of the existing ge…

Graph GenerationGraph Neural Network

Permutationally Invariant Networks for Enhanced Sampling (PINES): Discovery of Multi-Molecular and Solvent-Inclusive Collective Variables

2023-08-16 · Nicholas S. M. Herringer, Siva Dasetty, Diya Gandhi, Junhee Lee 외

The typically rugged nature of molecular free energy landscapes can frustrate efficient sampling of the thermodynamically relevant phase space due to the presence of high free energy barriers. Enhanced sampling technique…

Translation

GraphEBM: Towards Permutation Invariant and Multi-Objective Molecular Graph Generation

2021-09-29 · Meng Liu, Keqiang Yan, Bora Oztekin, Shuiwang Ji

Although significant progress has been made in molecular graph generation recently, permutation invariance and multi-objective generation remain to be important but challenging goals to achieve. In this work, we propose …

Drug DiscoveryGraph GenerationMolecular Graph Generation

Permutation-Invariant Spectral Learning via Dyson Diffusion

2025-10-09 · Tassilo Schwarz, Cai Dieball, Constantin Kogler, Renaud Lambiotte 외 arxiv

Diffusion models are central to generative modeling and have been adapted to graphs by diffusing adjacency matrix representations. The challenge of having up to $n!$ such representations for graphs with $n$ nodes is only…

Computational Efficiency