paper-with-me

홈 › Papers

Stochastic Averaging for Constrained Optimization with Application to Online Resource Allocation

2016-10-07 · Tianyi Chen, Aryan Mokhtari, Xin Wang, Alejandro Ribeiro, Georgios B. Giannakis

Existing approaches to resource allocation for nowadays stochastic networks are challenged to meet fast convergence and tolerable delay requirements. The present paper leverages online learning advances to facilitate stochastic resource allocation tasks. By recognizing the central role of Lagrange multipliers, the underlying constrained optimization problem is formulated as a machine learning task involving both training and operational modes, with the goal of learning the sought multipliers in a fast and efficient manner. To this end, an order-optimal offline learning approach is developed first for batch training, and it is then generalized to the online setting with a procedure termed learn-and-adapt. The novel resource allocation protocol permeates benefits of stochastic approximation and statistical learning to obtain low-complexity online updates with learning errors close to the statistical accuracy limits, while still preserving adaptation performance, which in the stochastic network optimization context guarantees queue stability. Analysis and simulated tests demonstrate that the proposed data-driven approach improves the delay and convergence performance of existing resource allocation schemes.

📄 PDF Abstract BibTeX arXiv:1610.02143

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Dual Averaging Method for Regularized Stochastic Learning and Online Optimization

2009-12-01 · NeurIPS 2009 12 · Lin Xiao

We consider regularized stochastic learning and online optimization problems, where the objective function is the sum of two convex terms: one is the loss function of the learning task, and the other is a simple regulari…

Stochastic Penalty-Barrier Methods for Constrained Machine Learning

2026-05-18 · Adam Bosák, Andrii Kliachkin, Jana Lepšová, Gilles Bareilles 외 arxiv

Constrained machine learning enables fairness-aware training, physics-informed neural networks, and integration of symbolic domain knowledge into statistical models. Despite its practical importance, no general method ex…

Online and Bandit Algorithms for Nonstationary Stochastic Saddle-Point Optimization

2019-12-03 · Abhishek Roy, Yifang Chen, Krishnakumar Balasubramanian, Prasant Mohapatra

Saddle-point optimization problems are an important class of optimization problems with applications to game theory, multi-agent reinforcement learning and machine learning. A majority of the rich literature available fo…

Multi-agent Reinforcement LearningReinforcement Learning

Asymptotic Optimality in Stochastic Optimization

2016-12-16 · John Duchi, Feng Ruan

We study local complexity measures for stochastic convex optimization problems, providing a local minimax theory analogous to that of H\'{a}jek and Le Cam for classical statistical problems. We give complementary optimal…

Stochastic Optimization

Online Stochastic Optimization with Multiple Objectives

2012-11-26 · Mehrdad Mahdavi, Tianbao Yang, Rong Jin

In this paper we propose a general framework to characterize and solve the stochastic optimization problems with multiple objectives underlying many real world learning applications. We first propose a projection based a…

Stochastic Optimization