Pre-training Molecular Graph Representation with 3D Geometry
Molecular graph representation learning is a fundamental problem in modern drug and material discovery. Molecular graphs are typically modeled by their 2D topological structures, but it has been recently discovered that 3D geometric information plays a more vital role in predicting molecular functionalities. However, the lack of 3D information in real-world scenarios has significantly impeded the learning of geometric graph representation. To cope with this challenge, we propose the Graph Multi-View Pre-training (GraphMVP) framework where self-supervised learning (SSL) is performed by leveraging the correspondence and consistency between 2D topological structures and 3D geometric views. GraphMVP effectively learns a 2D molecular graph encoder that is enhanced by richer and more discriminative 3D geometry. We further provide theoretical insights to justify the effectiveness of GraphMVP. Finally, comprehensive experiments show that GraphMVP can consistently outperform existing graph SSL methods.
Code (1)
Tasks
3D geometryGraph Representation LearningRepresentation LearningSelf-Supervised LearningSimilar Papers 제목 키워드 기반
ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Prediction
Effective molecular representation learning is of great importance to facilitate molecular property prediction, which is a fundamental task for the drug and material industry. Recent advances in graph neural networks (GN…
Molecular Property Predictionmolecular representationProperty Predictionregression+2GeoRecon: Graph-Level Representation Learning for 3D Molecules via Reconstruction-Based Pretraining
The pretraining-and-finetuning paradigm has driven significant advances across domains, such as natural language processing and computer vision, with representative pretraining paradigms such as masked language modeling …
DenoisingLanguage ModelingLanguage ModellingMasked Language Modeling+3Distance-Geometric Graph Attention Network (DG-GAT) for 3D Molecular Geometry
Deep learning for molecular science has so far mainly focused on 2D molecular graphs. Recently, however, there has been work to extend it to 3D molecular geometry, due to its scientific significance and critical importan…
Deep LearningGraph AttentionGeometry-aware Line Graph Transformer Pre-training for Molecular Property Prediction
Molecular property prediction with deep learning has gained much attention over the past years. Owing to the scarcity of labeled molecules, there has been growing interest in self-supervised learning methods that learn g…
3D geometryMolecular Property Predictionmolecular representationProperty Prediction+23D Pre-training improves GNNs for Molecular Property Prediction
Molecular property prediction is one of the fastest-growing applications of deep learning with critical real-world impacts. Including 3D molecular structure as input to learned models their performance for many molecular…
Graph Neural NetworkMolecular Property PredictionPredictionProperty Prediction+1