Identifying Semantic Component for Robust Molecular Property Prediction
Although graph neural networks have achieved great success in the task of molecular property prediction in recent years, their generalization ability under out-of-distribution (OOD) settings is still under-explored. Different from existing methods that learn discriminative representations for prediction, we propose a generative model with semantic-components identifiability, named SCI. We demonstrate that the latent variables in this generative model can be explicitly identified into semantic-relevant (SR) and semantic-irrelevant (SI) components, which contributes to better OOD generalization by involving minimal change properties of causal mechanisms. Specifically, we first formulate the data generation process from the atom level to the molecular level, where the latent space is split into SI substructures, SR substructures, and SR atom variables. Sequentially, to reduce misidentification, we restrict the minimal changes of the SR atom variables and add a semantic latent substructure regularization to mitigate the variance of the SR substructure under augmented domain changes. Under mild assumptions, we prove the block-wise identifiability of the SR substructure and the comment-wise identifiability of SR atom variables. Experimental studies achieve state-of-the-art performance and show general improvement on 21 datasets in 3 mainstream benchmarks. Moreover, the visualization results of the proposed SCI method provide insightful case studies and explanations for the prediction results. The code is available at: https://github.com/DMIRLAB-Group/SCI.
Code (1)
Tasks
Molecular Property PredictionPredictionProperty PredictionSimilar Papers 제목 키워드 기반
Contrastive Dual-Interaction Graph Neural Network for Molecular Property Prediction
Molecular property prediction is a key component of AI-driven drug discovery and molecular characterization learning. Despite recent advances, existing methods still face challenges such as limited ability to generalize,…
Drug DiscoveryGraph Neural NetworkMolecular Property PredictionPrediction+1GPS++: Reviving the Art of Message Passing for Molecular Property Prediction
We present GPS++, a hybrid Message Passing Neural Network / Graph Transformer model for molecular property prediction. Our model integrates a well-tuned local message passing component and biased global attention with ot…
Molecular Property PredictionProperty PredictionMulti-level Self-supervised Pretraining on Compositional Hierarchical Graph for Molecular Property Prediction
Self-supervised pretraining on molecular graphs has emerged as a promising approach for molecular property prediction, yet most existing methods operate at a single structural granularity and treat bond information as au…
Molecular Property PredictionKnown Unknowns: Out-of-Distribution Property Prediction in Materials and Molecules
Discovery of high-performance materials and molecules requires identifying extremes with property values that fall outside the known distribution. Therefore, the ability to extrapolate to out-of-distribution (OOD) proper…
Known UnknownsProperty PredictionA Systematic Evaluation of Molecular Mixture Behavior Prediction
Machine learning for molecular property prediction has focused largely on pure compounds, even though many practical applications depend on mixtures with intermolecular interactions. Recent work has expanded the availabi…
Molecular Property Prediction