paper-with-me

Papers

Learning-Based Heavy Hitters and Flow Frequency Estimation in Streams

2024-06-24 · Rana Shahout, Michael Mitzenmacher

Identifying heavy hitters and estimating the frequencies of flows are fundamental tasks in various network domains. Existing approaches to this challenge can broadly be categorized into two groups, hashing-based and competing-counter-based. The Count-Min sketch is a standard example of a hashing-based algorithm, and the Space Saving algorithm is an example of a competing-counter algorithm. Recent works have explored the use of machine learning to enhance algorithms for frequency estimation problems, under the algorithms with prediction framework. However, these works have focused solely on the hashing-based approach, which may not be best for identifying heavy hitters. In this paper, we present the first learned competing-counter-based algorithm, called LSS, for identifying heavy hitters, top k, and flow frequency estimation that utilizes the well-known Space Saving algorithm. We provide theoretical insights into how and to what extent our approach can improve upon Space Saving, backed by experimental results on both synthetic and real-world datasets. Our evaluation demonstrates that LSS can enhance the accuracy and efficiency of Space Saving in identifying heavy hitters, top k, and estimating flow frequencies.

📄 PDF Abstract BibTeX arXiv:2406.16270

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DPSW-Sketch: A Differentially Private Sketch Framework for Frequency Estimation over Sliding Windows (Technical Report)

2024-06-12 · Yiping Wang, Yanhao Wang, Cen Chen

The sliding window model of computation captures scenarios in which data are continually arriving in the form of a stream, and only the most recent $w$ items are used for analysis. In this setting, an algorithm needs to …

Communication Complexity in Locally Private Distribution Estimation and Heavy Hitters

2019-05-28 · Jayadev Acharya, Ziteng Sun

We consider the problems of distribution estimation and heavy hitter (frequency) estimation under privacy and communication constraints. While these constraints have been studied separately, optimal schemes for one are s…

Heavy Hitters and Bernoulli Convolutions

2019-05-22 · Alexander Kushkuley

A very simple event frequency approximation algorithm that is sensitive to event timeliness is suggested. The algorithm iteratively updates categorical click-distribution, producing (path of) a random walk on a standard …

Finding Frequent Entities in Continuous Data

2018-05-08 · Ferran Alet, Rohan Chitnis, Leslie P. Kaelbling, Tomas Lozano-Perez

In many applications that involve processing high-dimensional data, it is important to identify a small set of entities that account for a significant fraction of detections. Rather than formalize this as a clustering pr…

Clustering

Learning-Augmented Moment Estimation on Time-Decay Models

2026-03-03 · Soham Nagawanshi, Shalini Panthangi, Chen Wang, David P. Woodruff 외 arxiv

Motivated by the prevalence and success of machine learning, a line of recent work has studied learning-augmented algorithms in the streaming model. These results have shown that for natural and practical oracles impleme…