paper-with-me

홈 › Papers

Contextual Strongly Convex Simulation Optimization: Optimize then Predict with Inexact Solutions

2025-12-06 · Nifei Lin, Heng Luo, L. Jeff Hong arxiv

In this work, we study contextual strongly convex simulation optimization and adopt an "optimize then predict" (OTP) approach for real-time decision making. In the offline stage, simulation optimization is conducted across a set of covariates to approximate the optimal-solution function; in the online stage, decisions are obtained by evaluating this approximation at the observed covariate. The central theoretical challenge is to understand how the inexactness of solutions generated by simulation-optimization algorithms affects the optimality gap, which is overlooked in existing studies. To address this, we develop a unified analysis framework that explicitly accounts for both solution bias and variance. Using Polyak-Ruppert averaging SGD as an illustrative simulation-optimization algorithm, we analyze the optimality gap of OTP under four representative smoothing techniques: $k$ nearest neighbor, kernel smoothing, linear regression, and kernel ridge regression. We establish convergence rates, derive the optimal allocation of the computational budget $Γ$ between the number of design covariates and the per-covariate simulation effort, and demonstrate the convergence rate can approximately achieve $Γ^{-1}$ under appropriate smoothing technique and sample-allocation rule. Finally, through a numerical study, we validate the theoretical findings and demonstrate the effectiveness and practical value of the proposed approach.

📄 PDF Abstract BibTeX arXiv:2512.06270

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Similar Papers 제목 키워드 기반

Uniform a priori bounds and error analysis for the Adam stochastic gradient descent optimization method

2026-03-19 · Steffen Dereich, Thang Do, Arnulf Jentzen arxiv

The adaptive moment estimation (Adam) optimizer proposed by Kingma & Ba (2014) is presumably the most popular stochastic gradient descent (SGD) optimization method for the training of deep neural networks (DNNs) in artif…

Stochastic Optimization

Adam symmetry theorem: characterization of the convergence of the stochastic Adam optimizer

2025-11-10 · Steffen Dereich, Thang Do, Arnulf Jentzen, Philippe von Wurstemberger arxiv

Beside the standard stochastic gradient descent (SGD) method, the Adam optimizer due to Kingma & Ba (2014) is currently probably the best-known optimization method for the training of deep neural networks in artificial i…

A conversion theorem and minimax optimality for continuum contextual bandits

2024-06-09 · Arya Akhavan, Karim Lounici, Massimiliano Pontil, Alexandre B. Tsybakov

We study the contextual continuum bandits problem, where the learner sequentially receives a side information vector and has to choose an action in a convex set, minimizing a function associated with the context. The goa…

Multi-Armed Bandits

Contextual Learning for Stochastic Optimization

2025-05-22 · Anna Heuser, Thomas Kesselheim

Motivated by stochastic optimization, we introduce the problem of learning from samples of contextual value distributions. A contextual value distribution can be understood as a family of real-valued distributions, where…

Stochastic Optimization

Towards Understanding Why Lookahead Generalizes Better Than SGD and Beyond

2021-12-01 · NeurIPS 2021 12 · Pan Zhou, Hanshu Yan, Xiaotong Yuan, Jiashi Feng 외

To train networks, lookahead algorithm~\cite{zhang2019lookahead} updates its fast weights $k$ times via an inner-loop optimizer before updating its slow weights once by using the latest fast weights. Any optimizer, …