Simple GNN Regularisation for 3D Molecular Property Prediction and Beyond
Graph Neural Networks (GNNs) have been proven effective across a wide range of molecular property prediction and structured learning problems. However, their efficiency is known to be hindered by practical challenges such as oversmoothing. We introduce “Noisy Nodes”, a very simple technique for improved training of GNNs, in which we corrupt the input graph with noise, and add a noise correcting node-level loss. Adding noise helps overfitting, and the noise correction loss helps ameliorate oversmoothing by encouraging diverse node latents. Our regulariser applies well-studied methods in simple, straightforward ways which allows even generic architectures not designed for quantum chemistry to achieve state of the art results. We also demonstrate the effectiveness of Noisy Nodes with non-spatial architectures on Open Graph Benchmark (OGB) datasets. Our results suggest Noisy Nodes can serve as a complementary building block in the GNN toolkit for 3D molecular property prediction and beyond.
Code (0)
등록된 구현이 없습니다.
Tasks
Initial Structure to Relaxed Energy (IS2RE), DirectMolecular Property PredictionProperty PredictionSimilar Papers 제목 키워드 기반
Simple GNN Regularisation for 3D Molecular Property Prediction & Beyond
In this paper we show that simple noise regularisation can be an effective way to address GNN oversmoothing. First we argue that regularisers addressing oversmoothing should both penalise node latent similarity and encou…
DenoisingDiversityGraph Property PredictionInitial Structure to Relaxed Energy (IS2RE)+4Gated Graph Recursive Neural Networks for Molecular Property Prediction
Molecule property prediction is a fundamental problem for computer-aided drug discovery and materials science. Quantum-chemical simulations such as density functional theory (DFT) have been widely used for calculating th…
Drug DiscoveryMolecular Property PredictionPredictionProperty PredictionOn Sparsity in Overparametrised Shallow ReLU Networks
The analysis of neural network training beyond their linearization regime remains an outstanding open question, even in the simplest setup of a single hidden-layer. The limit of infinitely wide networks provides an appea…
Open-Ended Question AnsweringKnown Unknowns: Out-of-Distribution Property Prediction in Materials and Molecules
Discovery of high-performance materials and molecules requires identifying extremes with property values that fall outside the known distribution. Therefore, the ability to extrapolate to out-of-distribution (OOD) proper…
Known UnknownsProperty PredictionImproving VAE based molecular representations for compound property prediction
Collecting labeled data for many important tasks in chemoinformatics is time consuming and requires expensive experiments. In recent years, machine learning has been used to learn rich representations of molecules using …
BIG-bench Machine LearningPredictionProperty Prediction