paper-with-me

홈 › Papers

Learned LSM-trees: Two Approaches Using Learned Bloom Filters

2025-07-24 · Nicholas Fidalgo, Puyuan Ye arxiv

Modern key-value stores rely heavily on Log-Structured Merge (LSM) trees for write optimization, but this design introduces significant read amplification. Auxiliary structures like Bloom filters help, but impose memory costs that scale with tree depth and dataset size. Recent advances in learned data structures suggest that machine learning models can augment or replace these components, trading handcrafted heuristics for data-adaptive behavior. In this work, we explore two approaches for integrating learned predictions into the LSM-tree lookup path. The first uses a classifier to selectively bypass Bloom filter probes for irrelevant levels, aiming to reduce average-case query latency. The second replaces traditional Bloom filters with compact learned models and small backup filters, targeting memory footprint reduction without compromising correctness. We implement both methods atop a Monkey-style LSM-tree with leveled compaction, per-level Bloom filters, and realistic workloads. Our experiments show that the classifier reduces GET latency by up to 2.28x by skipping over 30% of Bloom filter checks with high precision, though it incurs a modest false-negative rate. The learned Bloom filter design achieves zero false negatives and retains baseline latency while cutting memory usage per level by 70-80%. Together, these designs illustrate complementary trade-offs between latency, memory, and correctness, and highlight the potential of learned index components in write-optimized storage systems.

📄 PDF Abstract BibTeX arXiv:2508.00882

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Model for Learned Bloom Filters, and Optimizing by Sandwiching

2019-01-03 · Michael Mitzenmacher

Recent work has suggested enhancing Bloom filters by using a pre-filter, based on applying machine learning to determine a function that models the data set the Bloom filter is meant to represent. Here we model such lear…

BIG-bench Machine Learning

A Model for Learned Bloom Filters and Optimizing by Sandwiching

2018-12-01 · NeurIPS 2018 12 · Michael Mitzenmacher

Recent work has suggested enhancing Bloom filters by using a pre-filter, based on applying machine learning to determine a function that models the data set the Bloom filter is meant to represent. Here we model such lea…

BIG-bench Machine Learning

Compressing (Multidimensional) Learned Bloom Filters

2022-08-05 · NeurIPS Workshop DBAI 2021 12 · Angjela Davitkova, Damjan Gjurovski, Sebastian Michel

Bloom filters are widely used data structures that compactly represent sets of elements. Querying a Bloom filter reveals if an element is not included in the underlying set or is included with a certain error rate. This …

Binary Classification

Partitioned Learned Bloom Filters

2021-01-01 · ICLR 2021 1 · Kapil Vaidya, Eric Knorr, Michael Mitzenmacher, Tim Kraska

Bloom filters are space-efficient probabilistic data structures that are used to test whether an element is a member of a set, and may return false positives. Recently, variations referred to as learned Bloom filters we…

Cascaded Learned Bloom Filter for Optimal Model-Filter Size Balance and Fast Rejection

2025-02-06 · Atsuki Sato, Yusuke Matsui

Recent studies have demonstrated that learned Bloom filters, which combine machine learning with the classical Bloom filter, can achieve superior memory efficiency. However, existing learned Bloom filters face two critic…