paper-with-me

홈 › Papers

Iterative Surrogate Model Optimization (ISMO): An active learning algorithm for PDE constrained optimization with deep neural networks

2020-08-13 · Kjetil O. Lye, Siddhartha Mishra, Deep Ray, Praveen Chandrasekhar

We present a novel active learning algorithm, termed as iterative surrogate model optimization (ISMO), for robust and efficient numerical approximation of PDE constrained optimization problems. This algorithm is based on deep neural networks and its key feature is the iterative selection of training data through a feedback loop between deep neural networks and any underlying standard optimization algorithm. Under suitable hypotheses, we show that the resulting optimizers converge exponentially fast (and with exponentially decaying variance), with respect to increasing number of training samples. Numerical examples for optimal control, parameter identification and shape optimization problems for PDEs are provided to validate the proposed theory and to illustrate that ISMO significantly outperforms a standard deep neural network based surrogate optimization algorithm.

📄 PDF Abstract BibTeX arXiv:2008.05730

Code (4)

kjetil-lye/ismo_airfoil 공식 구현
kjetil-lye/ismo_heat 공식 구현
kjetil-lye/ismo_validation 공식 구현
kjetil-lye/iterative_surrogate_optimization 공식 구현

Tasks

Active LearningModel Optimization

Similar Papers 제목 키워드 기반

Amortized Neural Optimization for Pre-Layout Signal Integrity Design Space Exploration using Differentiable Surrogates

2026-06-05 · Julian Withöft, Werner John, Emre Ecik, Ralf Brüning 외 arxiv

Pre-layout design space exploration (DSE) for high-speed signal integrity (SI) analysis is often limited by the computational cost of simulations and iterative optimization algorithms within modern electronic design auto…

MP-ISMoE: Mixed-Precision Interactive Side Mixture-of-Experts for Efficient Transfer Learning

2026-04-10 · Yutong Zhang, Zimeng Wu, Shangcai Liao, Shujiang Wu 외 arxiv

Parameter-efficient transfer learning (PETL) has emerged as a pivotal paradigm for adapting pre-trained foundation models to downstream tasks, significantly reducing trainable parameters yet suffering from substantial me…

Transfer Learning

SNAP: A semismooth Newton algorithm for pathwise optimization with optimal local convergence rate and oracle properties

2018-10-09 · Jian Huang, Yuling Jiao, Xiliang Lu, Yueyong Shi 외

We propose a semismooth Newton algorithm for pathwise optimization (SNAP) for the LASSO and Enet in sparse, high-dimensional linear regression. SNAP is derived from a suitable formulation of the KKT conditions based on N…

regression

Active preference learning based on radial basis functions

2019-09-28 · Alberto Bemporad, Dario Piga

This paper proposes a method for solving optimization problems in which the decision-maker cannot evaluate the objective function, but rather can only express a preference such as "this is better than that" between two c…

Bayesian Optimization

A Stochastic Semismooth Newton Method for Nonsmooth Nonconvex Optimization

2018-03-09 · Andre Milzarek, Xiantao Xiao, Shicong Cen, Zaiwen Wen 외

In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only …

Binary ClassificationStochastic Optimization