paper-with-me

홈 › Papers

Adaptive Sequential SAA for Solving Two-stage Stochastic Linear Programs

2020-12-07 · Raghu Pasupathy, Yongjia Song

We present adaptive sequential SAA (sample average approximation) algorithms to solve large-scale two-stage stochastic linear programs. The iterative algorithm framework we propose is organized into \emph{outer} and \emph{inner} iterations as follows: during each outer iteration, a sample-path problem is implicitly generated using a sample of observations or ``scenarios," and solved only \emph{imprecisely}, to within a tolerance that is chosen \emph{adaptively}, by balancing the estimated statistical error against solution error. The solutions from prior iterations serve as \emph{warm starts} to aid efficient solution of the (piecewise linear convex) sample-path optimization problems generated on subsequent iterations. The generated scenarios can be independent and identically distributed (iid), or dependent, as in Monte Carlo generation using Latin-hypercube sampling, antithetic variates, or randomized quasi-Monte Carlo. We first characterize the almost-sure convergence (and convergence in mean) of the optimality gap and the distance of the generated stochastic iterates to the true solution set. We then characterize the corresponding iteration complexity and work complexity rates as a function of the sample size schedule, demonstrating that the best achievable work complexity rate is Monte Carlo canonical and analogous to the generic $\mathcal{O}(\epsilon^{-2})$ optimal complexity for non-smooth convex optimization. We report extensive numerical tests that indicate favorable performance, due primarily to the use of a sequential framework with an optimal sample size schedule, and the use of warm starts. The proposed algorithm can be stopped in finite-time to return a solution endowed with a probabilistic guarantee on quality.

📄 PDF Abstract BibTeX arXiv:2012.03761

Code (0)

등록된 구현이 없습니다.

Tasks

Vocal Bursts Valence Prediction

Similar Papers 제목 키워드 기반

An Adaptive Stochastic Sequential Quadratic Programming with Differentiable Exact Augmented Lagrangians

2021-02-10 · Sen Na, Mihai Anitescu, Mladen Kolar

We consider solving nonlinear optimization problems with a stochastic objective and deterministic equality constraints. We assume for the objective that its evaluation, gradient, and Hessian are inaccessible, while one c…

Sequential Quadratic Optimization for Nonlinear Equality Constrained Stochastic Optimization

2020-07-20 · Albert Berahas, Frank E. Curtis, Daniel P. Robinson, Baoyu Zhou

Sequential quadratic optimization algorithms are proposed for solving smooth nonlinear optimization problems with equality constraints. The main focus is an algorithm proposed for the case when the constraint functions a…

Stochastic Optimization

Transformer-based Stagewise Decomposition for Large-Scale Multistage Stochastic Optimization

2024-04-03 · Chanyeong Kim, JongWoong Park, Hyunglip Bae, Woo Chang Kim

Solving large-scale multistage stochastic programming (MSP) problems poses a significant challenge as commonly used stagewise decomposition algorithms, including stochastic dual dynamic programming (SDDP), face growing t…

Stochastic Optimization

A Trust-Region Interior-Point Stochastic Sequential Quadratic Programming Method

2026-03-10 · Yuchen Fang, Jihun Kim, Sen Na, James Demmel 외 arxiv

In this paper, we propose a trust-region interior-point stochastic sequential quadratic programming (TR-IP-SSQP) method for solving optimization problems with a stochastic objective and deterministic nonlinear equality a…

Fully Stochastic Trust-Region Sequential Quadratic Programming for Equality-Constrained Optimization Problems

2022-11-29 · Yuchen Fang, Sen Na, Michael W. Mahoney, Mladen Kolar

We propose a trust-region stochastic sequential quadratic programming algorithm (TR-StoSQP) to solve nonlinear optimization problems with stochastic objectives and deterministic equality constraints. We consider a fully …