paper-with-me

Papers

Robust Learning-Augmented Caching: An Experimental Study

2021-06-28 · Jakub Chłędowski, Adam Polak, Bartosz Szabucki, Konrad Zolna

Effective caching is crucial for the performance of modern-day computing systems. A key optimization problem arising in caching -- which item to evict to make room for a new item -- cannot be optimally solved without knowing the future. There are many classical approximation algorithms for this problem, but more recently researchers started to successfully apply machine learning to decide what to evict by discovering implicit input patterns and predicting the future. While machine learning typically does not provide any worst-case guarantees, the new field of learning-augmented algorithms proposes solutions that leverage classical online caching algorithms to make the machine-learned predictors robust. We are the first to comprehensively evaluate these learning-augmented algorithms on real-world caching datasets and state-of-the-art machine-learned predictors. We show that a straightforward method -- blindly following either a predictor or a classical robust algorithm, and switching whenever one becomes worse than the other -- has only a low overhead over a well-performing predictor, while competing with classical methods when the coupled predictor fails, thus providing a cheap worst-case insurance.

📄 PDF Abstract BibTeX arXiv:2106.14693

Code (1)

chledowski/Robust-Learning-Augmented-Caching-An-Experimental-Study-Datasets 공식 구현

Tasks

BIG-bench Machine Learning

Similar Papers 제목 키워드 기반

Parsimonious Learning-Augmented Caching

2022-02-09 · Sungjin Im, Ravi Kumar, Aditya Petety, Manish Purohit

Learning-augmented algorithms -- in which, traditional algorithms are augmented with machine-learned predictions -- have emerged as a framework to go beyond worst-case analysis. The overarching goal is to design algorith…

An experimental study of KV cache reuse strategies in chunk-level caching systems

2026-03-03 · Samuel Cestola, Tianxiang Xia, Zheng Weiyan, Zheng Pengfei 외 arxiv

Retrieval-augmented generation improves large language models' accuracy by adding relevant retrieved text to the prompt. Chunk level caching (CLC) accelerates inference by precomputing KV caches for these retrieved chunk…

Emergency Caching: Coded Caching-based Reliable Map Transmission in Emergency Networks

2024-02-27 · Zeyu Tian, Lianming Xu, Liang Li, Li Wang 외

Many rescue missions demand effective perception and real-time decision making, which highly rely on effective data collection and processing. In this study, we propose a three-layer architecture of emergency caching net…

Decision MakingDeep Reinforcement Learning

Robustifying Learning-Augmented Caching Efficiently without Compromising 1-Consistency

2025-07-22 · Peng Chen, Hailiang Zhao, Jiaji Zhang, Xueyan Tang 외 arxiv

The online caching problem aims to minimize cache misses when serving a sequence of requests under a limited cache size. While naive learning-augmented caching algorithms achieve ideal $1$-consistency, they lack robustne…

MPIC: Position-Independent Multimodal Context Caching System for Efficient MLLM Serving

2025-02-04 · Shiju Zhao, Junhao Hu, Rongxiao Huang, Jiaqi Zheng 외

The context caching technique is employed to accelerate the Multimodal Large Language Model (MLLM) inference by prevailing serving platforms currently. However, this approach merely reuses the Key-Value (KV) cache of the…

Language ModelingLanguage ModellingLarge Language ModelMultimodal Large Language Model+2