paper-with-me

홈 › Papers

PDE-DKL: PDE-constrained deep kernel learning in high dimensionality

2025-01-30 · Weihao Yan, Christoph Brune, Mengwu Guo

Many physics-informed machine learning methods for PDE-based problems rely on Gaussian processes (GPs) or neural networks (NNs). However, both face limitations when data are scarce and the dimensionality is high. Although GPs are known for their robust uncertainty quantification in low-dimensional settings, their computational complexity becomes prohibitive as the dimensionality increases. In contrast, while conventional NNs can accommodate high-dimensional input, they often require extensive training data and do not offer uncertainty quantification. To address these challenges, we propose a PDE-constrained Deep Kernel Learning (PDE-DKL) framework that combines DL and GPs under explicit PDE constraints. Specifically, NNs learn a low-dimensional latent representation of the high-dimensional PDE problem, reducing the complexity of the problem. GPs then perform kernel regression subject to the governing PDEs, ensuring accurate solutions and principled uncertainty quantification, even when available data are limited. This synergy unifies the strengths of both NNs and GPs, yielding high accuracy, robust uncertainty estimates, and computational efficiency for high-dimensional PDEs. Numerical experiments demonstrate that PDE-DKL achieves high accuracy with reduced data requirements. They highlight its potential as a practical, reliable, and scalable solver for complex PDE-based applications in science and engineering.

📄 PDF Abstract BibTeX arXiv:2501.18258

Code (1)

VhaoYan/PDE-constrained-DKL 공식 구현 jax

Tasks

Computational EfficiencyGaussian ProcessesPhysics-informed machine learningUncertainty Quantification

Methods 이 논문이 사용한 방법론

GPS Greedy Policy Search (GPS) is a simple algorithm that learns a policy for test-time data augmentation based on the predictive performance on a validation set. GPS starts with…

Similar Papers 제목 키워드 기반

The loss of the property of locality of the kernel in high-dimensional Gaussian process regression on the example of the fitting of molecular potential energy surfaces

2022-11-21 · Sergei Manzhos, Manabu Ihara

Kernel based methods including Gaussian process regression (GPR) and generally kernel ridge regression (KRR) have been finding increasing use in computational chemistry, including the fitting of potential energy surfaces…

Computational chemistryGPRregression

Local Constrained Bayesian Optimization

2026-03-09 · Jing Jingzhe, Fan Zheyi, Szu Hui Ng, Qingpei Hu arxiv

Bayesian optimization (BO) for high-dimensional constrained problems remains a significant challenge due to the curse of dimensionality. We propose Local Constrained Bayesian Optimization (LCBO), a novel framework tailor…

Deep Diffusion Maps

2025-05-09 · Sergio García-Heredia, Ángela Fernández, Carlos M. Alaíz

One of the fundamental problems within the field of machine learning is dimensionality reduction. Dimensionality reduction methods make it possible to combat the so-called curse of dimensionality, visualize high-dimensio…

Dimensionality Reduction

Breaking the curse of dimensionality with Isolation Kernel

2021-09-29 · Kai Ming Ting, Takashi Washio, Ye Zhu, Yang Xu

The curse of dimensionality has been studied in different aspects. However, breaking the curse has been elusive. We show for the first time that it is possible to break the curse using the recently introduced Isolation K…

Clustering

Fast Graph Laplacian Regularized Kernel Learning via Semidefinite–Quadratic–Linear Programming

2009-12-01 · NeurIPS 2009 12 · Xiao-Ming Wu, Anthony M. So, Zhenguo Li, Shuo-Yen R. Li

Kernel learning is a powerful framework for nonlinear data modeling. Using the kernel trick, a number of problems have been formulated as semidefinite programs (SDPs). These include Maximum Variance Unfolding (MVU) (Wein…

ClusteringComputational EfficiencyConstrained ClusteringDimensionality Reduction