paper-with-me

홈 › Papers

Active Model Aggregation via Stochastic Mirror Descent

2015-03-28 · Ravi Ganti

We consider the problem of learning convex aggregation of models, that is as good as the best convex aggregation, for the binary classification problem. Working in the stream based active learning setting, where the active learner has to make a decision on-the-fly, if it wants to query for the label of the point currently seen in the stream, we propose a stochastic-mirror descent algorithm, called SMD-AMA, with entropy regularization. We establish an excess risk bounds for the loss of the convex aggregate returned by SMD-AMA to be of the order of $O\left(\sqrt{\frac{\log(M)}{{T^{1-\mu}}}}\right)$, where $\mu\in [0,1)$ is an algorithm dependent parameter, that trades-off the number of labels queried, and excess risk.

📄 PDF Abstract BibTeX arXiv:1503.08363

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningBinary ClassificationGeneral Classificationmodel

Similar Papers 제목 키워드 기반

Linear Convergence of Generalized Mirror Descent with Time-Dependent Mirrors

2020-09-18 · Adityanarayanan Radhakrishnan, Mikhail Belkin, Caroline Uhler

The Polyak-Lojasiewicz (PL) inequality is a sufficient condition for establishing linear convergence of gradient descent, even in non-convex settings. While several recent works use a PL-based analysis to establish linea…

Efficient Mirror Descent Ascent Methods for Nonsmooth Minimax Problems

2021-12-01 · NeurIPS 2021 12 · Feihu Huang, Xidong Wu, Heng Huang

In the paper, we propose a class of efficient mirror descent ascent methods to solve the nonsmooth nonconvex-strongly-concave minimax problems by using dynamic mirror functions, and introduce a convergence analysis fram…

Stochastic Mirror Descent: Convergence Analysis and Adaptive Variants via the Mirror Stochastic Polyak Stepsize

2021-10-28 · Ryan D'Orazio, Nicolas Loizou, Issam Laradji, Ioannis Mitliagkas

We investigate the convergence of stochastic mirror descent (SMD) under interpolation in relatively smooth and smooth convex optimization. In relatively smooth convex optimization we provide new convergence guarantees fo…

Markov Chain Mirror Descent On Data Federation

2023-09-26 · Yawei Zhao

Stochastic optimization methods such as mirror descent have wide applications due to low computational cost. Those methods have been well studied under assumption of the independent and identical distribution, and usuall…

Federated LearningStochastic Optimization

Mirror Descent on Riemannian Manifolds

2026-03-18 · Jiaxin Jiang, Lei Shi, Jiyuan Tan arxiv

Mirror Descent (MD) is a scalable first-order method widely used in large-scale optimization, with applications in image processing, policy optimization, and neural network training. This paper generalizes MD to optimiza…