paper-with-me

Papers

Efficient PDE-Constrained optimization under high-dimensional uncertainty using derivative-informed neural operators

2023-05-31 · Dingcheng Luo, Thomas O'Leary-Roseberry, Peng Chen, Omar Ghattas

We propose a novel machine learning framework for solving optimization problems governed by large-scale partial differential equations (PDEs) with high-dimensional random parameters. Such optimization under uncertainty (OUU) problems may be computational prohibitive using classical methods, particularly when a large number of samples is needed to evaluate risk measures at every iteration of an optimization algorithm, where each sample requires the solution of an expensive-to-solve PDE. To address this challenge, we propose a new neural operator approximation of the PDE solution operator that has the combined merits of (1) accurate approximation of not only the map from the joint inputs of random parameters and optimization variables to the PDE state, but also its derivative with respect to the optimization variables, (2) efficient construction of the neural network using reduced basis architectures that are scalable to high-dimensional OUU problems, and (3) requiring only a limited number of training data to achieve high accuracy for both the PDE solution and the OUU solution. We refer to such neural operators as multi-input reduced basis derivative informed neural operators (MR-DINOs). We demonstrate the accuracy and efficiency our approach through several numerical experiments, i.e. the risk-averse control of a semilinear elliptic PDE and the steady state Navier--Stokes equations in two and three spatial dimensions, each involving random field inputs. Across the examples, MR-DINOs offer $10^{3}$--$10^{7} \times$ reductions in execution time, and are able to produce OUU solutions of comparable accuracies to those from standard PDE based solutions while being over $10 \times$ more cost-efficient after factoring in the cost of construction.

📄 PDF Abstract BibTeX arXiv:2305.20053

Code (2)

hippylib/hippyflow 공식 구현 tf
tomoleary/dino tf

Similar Papers 제목 키워드 기반

Local Constrained Bayesian Optimization

2026-03-09 · Jing Jingzhe, Fan Zheyi, Szu Hui Ng, Qingpei Hu arxiv

Bayesian optimization (BO) for high-dimensional constrained problems remains a significant challenge due to the curse of dimensionality. We propose Local Constrained Bayesian Optimization (LCBO), a novel framework tailor…

BayeSQP: Bayesian Optimization through Sequential Quadratic Programming

2026-02-03 · Paul Brunzema, Sebastian Trimpe arxiv

We introduce BayeSQP, a novel algorithm for general black-box optimization that merges the structure of sequential quadratic programming with concepts from Bayesian optimization. BayeSQP employs second-order Gaussian pro…

Trust Region Constrained Bayesian Optimization with Penalized Constraint Handling

2026-03-25 · Raju Chowdhury, Tanmay Sen, Prajamitra Bhuyan, Biswabrata Pradhan arxiv

Constrained optimization in high-dimensional black-box settings is difficult due to expensive evaluations, the lack of gradient information, and complex feasibility regions. In this work, we propose a Bayesian optimizati…

PDE-DKL: PDE-constrained deep kernel learning in high dimensionality

2025-01-30 · Weihao Yan, Christoph Brune, Mengwu Guo

Many physics-informed machine learning methods for PDE-based problems rely on Gaussian processes (GPs) or neural networks (NNs). However, both face limitations when data are scarce and the dimensionality is high. Althoug…

Computational EfficiencyGaussian ProcessesPhysics-informed machine learningUncertainty Quantification

Safe Continuous Control with Constrained Model-Based Policy Optimization

2021-04-14 · Moritz A. Zanger, Karam Daaboul, J. Marius Zöllner

The applicability of reinforcement learning (RL) algorithms in real-world domains often requires adherence to safety constraints, a need difficult to address given the asymptotic nature of the classic RL optimization obj…

continuous-controlContinuous ControlReinforcement Learning (RL)Safe Exploration