paper-with-me

홈 › Papers

Algorithms and Improved bounds for online learning under finite hypothesis class

2019-03-24 · Ankit Sharma, Late C. A. Murthy

Online learning is the process of answering a sequence of questions based on the correct answers to the previous questions. It is studied in many research areas such as game theory, information theory and machine learning. There are two main components of online learning framework. First, the learning algorithm also known as the learner and second, the hypothesis class which is essentially a set of functions which learner uses to predict answers to the questions. Sometimes, this class contains some functions which have the capability to provide correct answers to the entire sequence of questions. This case is called realizable case. And when hypothesis class does not contain such functions is called unrealizable case. The goal of the learner, in both the cases, is to make as few mistakes as that could have been made by most powerful functions in hypothesis class over the entire sequence of questions. Performance of the learners is analysed by theoretical bounds on the number of mistakes made by them. This paper proposes three algorithms to improve the mistakes bound in the unrealizable case. Proposed algorithms perform highly better than the existing ones in the long run when most of the input sequences presented to the learner are likely to be realizable.

📄 PDF Abstract BibTeX arXiv:1903.10870

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Bit of Freedom Goes a Long Way: Classical and Quantum Algorithms for Reinforcement Learning under a Generative Model

2025-07-30 · Andris Ambainis, Joao F. Doriguello, Debbie Lim arxiv

We propose novel classical and quantum online algorithms for learning finite- and infinite-horizon Markov Decision Processes (MDPs). Our algorithms are based on a hybrid online-offline reinforcement learning model wherei…

Reinforcement Learning

Optimized projection-free algorithms for online learning: construction and worst-case analysis

2025-06-06 · Julien Weibel, Pierre Gaillard, Wouter M. Koolen, Adrien Taylor

This work studies and develop projection-free algorithms for online learning with linear optimization oracles (a.k.a. Frank-Wolfe) for handling the constraint set. More precisely, this work (i) provides an improved (opti…

Online Semi-infinite Linear Programming: Efficient Algorithms via Function Approximation

2026-03-17 · Yiming Zong, Jiashuo Jiang arxiv

We consider the dynamic resource allocation problem where the decision space is finite-dimensional, yet the solution must satisfy a large or even infinite number of constraints revealed via streaming data or oracle feedb…

Dynamic Regret of Online Markov Decision Processes

2022-08-26 · Peng Zhao, Long-Fei Li, Zhi-Hua Zhou

We investigate online Markov Decision Processes (MDPs) with adversarially changing loss functions and known transitions. We choose dynamic regret as the performance measure, defined as the performance difference between …

Optimized Gradient Tracking for Decentralized Online Learning

2023-06-10 · Shivangi Dubey Sharma, Ketan Rajawat

This work considers the problem of decentralized online learning, where the goal is to track the optimum of the sum of time-varying functions, distributed across several nodes in a network. The local availability of the …