paper-with-me

Papers

Sequential Quadratic Optimization for Nonlinear Equality Constrained Stochastic Optimization

2020-07-20 · Albert Berahas, Frank E. Curtis, Daniel P. Robinson, Baoyu Zhou

Sequential quadratic optimization algorithms are proposed for solving smooth nonlinear optimization problems with equality constraints. The main focus is an algorithm proposed for the case when the constraint functions are deterministic, and constraint function and derivative values can be computed explicitly, but the objective function is stochastic. It is assumed in this setting that it is intractable to compute objective function and derivative values explicitly, although one can compute stochastic function and gradient estimates. As a starting point for this stochastic setting, an algorithm is proposed for the deterministic setting that is modeled after a state-of-the-art line-search SQP algorithm, but uses a stepsize selection scheme based on Lipschitz constants (or adaptively estimated Lipschitz constants) in place of the line search. This sets the stage for the proposed algorithm for the stochastic setting, for which it is assumed that line searches would be intractable. Under reasonable assumptions, convergence (resp.,~convergence in expectation) from remote starting points is proved for the proposed deterministic (resp.,~stochastic) algorithm. The results of numerical experiments demonstrate the practical performance of our proposed techniques.

📄 PDF Abstract BibTeX arXiv:2007.10525

Code (1)

frankecurtis/StochasticSQP

Tasks

Stochastic Optimization

Similar Papers 제목 키워드 기반

A Sequential Quadratic Programming Method with High Probability Complexity Bounds for Nonlinear Equality Constrained Stochastic Optimization

2023-01-01 · Albert S. Berahas, Miaolan Xie, Baoyu Zhou

A step-search sequential quadratic programming method is proposed for solving nonlinear equality constrained stochastic optimization problems. It is assumed that constraint function values and derivatives are available, …

Stochastic Optimization

Inequality Constrained Stochastic Nonlinear Optimization via Active-Set Sequential Quadratic Programming

2021-09-23 · Sen Na, Mihai Anitescu, Mladen Kolar

We study nonlinear optimization problems with a stochastic objective and deterministic equality and inequality constraints, which emerge in numerous applications including finance, manufacturing, power systems and, recen…

A Stochastic Sequential Quadratic Optimization Algorithm for Nonlinear Equality Constrained Optimization with Rank-Deficient Jacobians

2021-06-24 · Albert S. Berahas, Frank E. Curtis, Michael J. O'Neill, Daniel P. Robinson

A sequential quadratic optimization algorithm is proposed for solving smooth nonlinear equality constrained optimization problems in which the objective function is defined by an expectation of a stochastic function. The…

Online Inference of Constrained Optimization: Primal-Dual Optimality and Sequential Quadratic Programming

2025-11-27 · Yihang Gao, Michael K. Ng, Michael W. Mahoney, Sen Na arxiv

We study online statistical inference for the solutions of stochastic optimization problems with equality and inequality constraints. Such problems are prevalent in statistics and machine learning, encompassing constrain…

Stochastic OptimizationReinforcement Learning

Fully Stochastic Trust-Region Sequential Quadratic Programming for Equality-Constrained Optimization Problems

2022-11-29 · Yuchen Fang, Sen Na, Michael W. Mahoney, Mladen Kolar

We propose a trust-region stochastic sequential quadratic programming algorithm (TR-StoSQP) to solve nonlinear optimization problems with stochastic objectives and deterministic equality constraints. We consider a fully …