paper-with-me

Papers

Stochastic $L^\natural$-convex Function Minimization

2021-12-01 · NeurIPS 2021 12 · Haixiang Zhang, Zeyu Zheng, Javad Lavaei

We study an extension of the stochastic submodular minimization problem, namely, the stochastic $L^\natural$-convex minimization problem. We develop the first polynomial-time algorithms that return a near-optimal solution with high probability. We design a novel truncation operation to further reduce the computational complexity of the proposed algorithms. When applied to a stochastic submodular function, the computational complexity of the proposed algorithms is lower than that of the existing stochastic submodular minimization algorithms. In addition, we provide a strongly polynomial approximate algorithm. The algorithm execution also does not require any prior knowledge about the objective function except the $L^\natural$-convexity. A lower bound on the computational complexity that is required to achieve a high probability error bound is also derived. Numerical experiments are implemented to demonstrate the efficiency of our theoretical findings.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Stochastic model-based minimization under high-order growth

2018-07-01 · Damek Davis, Dmitriy Drusvyatskiy, Kellie J. MacPhee

Given a nonsmooth, nonconvex minimization problem, we consider algorithms that iteratively sample and minimize stochastic convex models of the objective function. Assuming that the one-sided approximation quality and the…

modelVocal Bursts Intensity Prediction

Stochastic Optimization for Non-convex Inf-Projection Problems

2019-08-26 · ICML 2020 1 · Yan Yan, Yi Xu, Lijun Zhang, Xiaoyu Wang 외

In this paper, we study a family of non-convex and possibly non-smooth inf-projection minimization problems, where the target objective function is equal to minimization of a joint function over another variable. This pr…

Stochastic Optimization

Stochastic model-based minimization of weakly convex functions

2018-03-17 · Damek Davis, Dmitriy Drusvyatskiy

We consider a family of algorithms that successively sample and minimize simple stochastic models of the objective function. We show that under reasonable conditions on approximation quality and regularity of the models,…

model

Un-regularizing: approximate proximal point and faster stochastic algorithms for empirical risk minimization

2015-06-24 · Roy Frostig, Rong Ge, Sham M. Kakade, Aaron Sidford

We develop a family of accelerated stochastic algorithms that minimize sums of convex functions. Our algorithms improve upon the fastest running time for empirical risk minimization (ERM), and in particular linear least-…

Stochastic subGradient Methods with Linear Convergence for Polyhedral Convex Optimization

2015-10-06 · Tianbao Yang, Qihang Lin

In this paper, we show that simple {Stochastic} subGradient Decent methods with multiple Restarting, named {\bf RSGD}, can achieve a \textit{linear convergence rate} for a class of non-smooth and non-strongly convex opti…

BIG-bench Machine Learning