An ensemble of VisNet, Transformer-M, and pretraining models for molecular property prediction in OGB Large-Scale Challenge @ NeurIPS 2022
In the technical report, we provide our solution for OGB-LSC 2022 Graph Regression Task. The target of this task is to predict the quantum chemical property, HOMO-LUMO gap for a given molecule on PCQM4Mv2 dataset. In the competition, we designed two kinds of models: Transformer-M-ViSNet which is an geometry-enhanced graph neural network for fully connected molecular graphs and Pretrained-3D-ViSNet which is a pretrained ViSNet by distilling geomeotric information from optimized structures. With an ensemble of 22 models, ViSNet Team achieved the MAE of 0.0723 eV on the test-challenge set, dramatically reducing the error by 39.75% compared with the best method in the last year competition.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph Neural NetworkGraph RegressionMolecular Property PredictionProperty PredictionregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Prediction
GNNs and chemical fingerprints are the predominant approaches to representing molecules for property prediction. However, in NLP, transformers have become the de-facto standard for representation learning thanks to their…
Molecular Property Predictionmolecular representationPredictionProperty Prediction+1Learning the Neighborhood: Contrast-Free Multimodal Self-Supervised Molecular Graph Pretraining
High-quality molecular representations are essential for property prediction and molecular design, yet large labeled datasets remain scarce. While self-supervised pretraining on molecular graphs has shown promise, many e…
Representation LearningGraph Neural NetworkAll You Need Is Synthetic Task Augmentation
Injecting rule-based models like Random Forests into differentiable neural network frameworks remains an open challenge in machine learning. Recent advancements have demonstrated that pretrained models can generate effic…
AllMolecular Property PredictionProperty PredictionHeterogenous Ensemble of Models for Molecular Property Prediction
Previous works have demonstrated the importance of considering different modalities on molecules, each of which provide a varied granularity of information for downstream property prediction tasks. Our method combines va…
Molecular Property PredictionPredictionProperty PredictionvalidSmilesT5: Domain-specific pretraining for molecular language models
Molecular property prediction is an increasingly critical task within drug discovery and development. Typically, neural networks can learn molecular properties using graph-based, language-based or feature-based methods. …
Molecular Property PredictionComputational EfficiencyLanguage ModellingDrug Discovery