paper-with-me

Papers

Performance-bounded Online Ensemble Learning Method Based on Multi-armed bandits and Its Applications in Real-time Safety Assessment

2025-03-19 · Songqiao Hu, Zeyi Liu, Xiao He

Ensemble learning plays a crucial role in practical applications of online learning due to its enhanced classification performance and adaptable adjustment mechanisms. However, most weight allocation strategies in ensemble learning are heuristic, making it challenging to theoretically guarantee that the ensemble classifier outperforms its base classifiers. To address this issue, a performance-bounded online ensemble learning method based on multi-armed bandits, named PB-OEL, is proposed in this paper. Specifically, multi-armed bandit with expert advice is incorporated into online ensemble learning, aiming to update the weights of base classifiers and make predictions. A theoretical framework is established to bound the performance of the ensemble classifier relative to base classifiers. By setting expert advice of bandits, the bound exceeds the performance of any base classifier when the length of data stream is sufficiently large. Additionally, performance bounds for scenarios with limited annotations are also derived. Numerous experiments on benchmark datasets and a dataset of real-time safety assessment tasks are conducted. The experimental results validate the theoretical bound to a certain extent and demonstrate that the proposed method outperforms existing state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2503.15581

Code (1)

liuzy0708/Awesome_OL 공식 구현

Tasks

Ensemble LearningMulti-Armed Bandits

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

Combinatorial Multi-armed Bandit with Probabilistically Triggered Arms: A Case with Bounded Regret

2017-07-24 · A. Ömer Sarıtaç, Cem Tekin

In this paper, we study the combinatorial multi-armed bandit problem (CMAB) with probabilistically triggered arms (PTAs). Under the assumption that the arm triggering probabilities (ATPs) are positive for all arms, we pr…

Movie RecommendationThompson Sampling

Beyond the Hazard Rate: More Perturbation Algorithms for Adversarial Multi-armed Bandits

2017-02-17 · Zifan Li, Ambuj Tewari

Recent work on follow the perturbed leader (FTPL) algorithms for the adversarial multi-armed bandit problem has highlighted the role of the hazard rate of the distribution generating the perturbations. Assuming that the …

Multi-Armed Bandits

Batch Ensemble for Variance Dependent Regret in Stochastic Bandits

2024-09-13 · Asaf Cassel, Orin Levy, Yishay Mansour

Efficiently trading off exploration and exploitation is one of the key challenges in online Reinforcement Learning (RL). Most works achieve this by carefully estimating the model uncertainty and following the so-called o…

Multi-Armed BanditsReinforcement Learning (RL)

UQ-ARMED: Uncertainty quantification of adversarially-regularized mixed effects deep learning for clustered non-iid data

2022-11-29 · Alex Treacher, Kevin Nguyen, Dylan Owens, Daniel Heitjan 외

This work demonstrates the ability to produce readily interpretable statistical metrics for model fit, fixed effects covariance coefficients, and prediction confidence. Importantly, this work compares 4 suitable and comm…

PredictionPrognosisUncertainty Quantification

Gradient-free Online Learning in Continuous Games with Delayed Rewards

2020-01-01 · ICML 2020 1 · Amélie Héliou, Panayotis Mertikopoulos, Zhengyuan Zhou

Motivated by applications to online advertising and recommender systems, we consider a game-theoretic model with delayed rewards and asynchronous, payoff-based feedback. In contrast to previous work on delayed multi-arme…

Multi-Armed BanditsRecommendation Systems