Meta-learning Adaptive Deep Kernel Gaussian Processes for Molecular Property Prediction
We propose Adaptive Deep Kernel Fitting with Implicit Function Theorem (ADKF-IFT), a novel framework for learning deep kernel Gaussian processes (GPs) by interpolating between meta-learning and conventional deep kernel learning. Our approach employs a bilevel optimization objective where we meta-learn generally useful feature representations across tasks, in the sense that task-specific GP models estimated on top of such features achieve the lowest possible predictive loss on average. We solve the resulting nested optimization problem using the implicit function theorem (IFT). We show that our ADKF-IFT framework contains previously proposed Deep Kernel Learning (DKL) and Deep Kernel Transfer (DKT) as special cases. Although ADKF-IFT is a completely general method, we argue that it is especially well-suited for drug discovery problems and demonstrate that it significantly outperforms previous state-of-the-art methods on a variety of real-world few-shot molecular property prediction tasks and out-of-domain molecular property prediction and optimization tasks.
Code (1)
Tasks
Bilevel OptimizationDrug DiscoveryGaussian ProcessesMeta-LearningMolecular Property PredictionProperty PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Isotropic Gaussian Processes on Finite Spaces of Graphs
We propose a principled way to define Gaussian process priors on various sets of unweighted graphs: directed or undirected, with or without loops. We endow each of these sets with a geometric structure, inducing the noti…
Gaussian ProcessesMolecular Property PredictionProperty PredictionGAUCHE: A Library for Gaussian Processes in Chemistry
We introduce GAUCHE, a library for GAUssian processes in CHEmistry. Gaussian processes have long been a cornerstone of probabilistic machine learning, affording particular advantages for uncertainty quantification and Ba…
Bayesian OptimisationGaussian ProcessesUncertainty QuantificationScalable Gaussian Processes on Discrete Domains
Kernel methods on discrete domains have shown great promise for many challenging data types, for instance, biological sequence data and molecular structure data. Scalable kernel methods like Support Vector Machines may o…
Gaussian ProcessesPoint ProcessesMeta-Learning Theory-Informed Inductive Biases using Deep Kernel Gaussian Processes
Normative and task-driven theories offer powerful top-down explanations for biological systems, yet the goals of quantitatively arbitrating between competing theories, and utilizing them as inductive biases to improve da…
Gaussian ProcessesMeta-learning to Calibrate Gaussian Processes with Deep Kernels for Regression Uncertainty Estimation
Although Gaussian processes (GPs) with deep kernels have been successfully used for meta-learning in regression tasks, its uncertainty estimation performance can be poor. We propose a meta-learning method for calibrating…
Gaussian ProcessesMeta-Learningregression