paper-with-me

Papers

An Online Gradient-Based Caching Policy with Logarithmic Complexity and Regret Guarantees

2024-05-02 · Damiano Carra, Giovanni Neglia

Commonly used caching policies, such as LRU (Least Recently Used) or LFU (Least Frequently Used), exhibit optimal performance only under specific traffic patterns. Even advanced machine learning-based methods, which detect patterns in historical request data, struggle when future requests deviate from past trends. Recently, a new class of policies has emerged that are robust to varying traffic patterns. These algorithms address an online optimization problem, enabling continuous adaptation to the context. They offer theoretical guarantees on the regret metric, which measures the performance gap between the online policy and the optimal static cache allocation in hindsight. However, the high computational complexity of these solutions hinders their practical adoption. In this study, we introduce a new variant of the gradient-based online caching policy that achieves groundbreaking logarithmic computational complexity relative to catalog size, while also providing regret guarantees. This advancement allows us to test the policy on large-scale, real-world traces featuring millions of requests and items - a significant achievement, as such scales have been beyond the reach of existing policies with regret guarantees. To the best of our knowledge, our experimental results demonstrate for the first time that the regret guarantees of gradient-based caching policies offer substantial benefits in practical scenarios.

📄 PDF Abstract BibTeX arXiv:2405.01263

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Efficient and Optimal No-Regret Caching under Partial Observation

2025-03-04 · Younes Ben Mazziane, Francescomaria Faticanti, Sara Alouf, Giovanni Neglia

Online learning algorithms have been successfully used to design caching policies with sublinear regret in the total number of requests, with no statistical assumption about the request sequence. Most existing algorithms…

Follow The Approximate Sparse Leader for No-Regret Online Sparse Linear Approximation

2025-01-01 · Samrat Mukhopadhyay, Debasmita Mukherjee

We consider the problem of \textit{online sparse linear approximation}, where one predicts the best sparse approximation of a sequence of measurements in terms of linear combination of columns of a given measurement matr…

Optimistic No-regret Algorithms for Discrete Caching

2022-08-15 · Naram Mhaisen, Abhishek Sinha, Georgios Paschos, Georgios Iosifidis

We take a systematic look at the problem of storing whole files in a cache with limited capacity in the context of optimistic learning, where the caching policy has access to a prediction oracle (provided by, e.g., a Neu…

Universal Caching

2022-05-10 · Ativ Joshi, Abhishek Sinha

In learning theory, the performance of an online policy is commonly measured in terms of the static regret metric, which compares the cumulative loss of an online policy to that of an optimal benchmark in hindsight. In t…

Learning Theory

$ε$-Policy Gradient for Online Pricing

2024-05-06 · Lukasz Szpruch, Tanut Treetanthiploet, Yufei Zhang

Combining model-based and model-free reinforcement learning approaches, this paper proposes and analyzes an $\epsilon$-policy gradient algorithm for the online pricing learning task. The algorithm extends $\epsilon$-gree…