paper-with-me

홈 › Papers

LearnedKV: Integrating LSM and Learned Index for Superior Performance on Storage

2024-06-27 · Wenlong Wang, David Hung-Chang Du

We present LearnedKV, a novel tiered key-value store that seamlessly integrates a Log-Structured Merge (LSM) tree with a Learned Index to achieve superior read and write performance on storage systems. While existing approaches use learned indexes primarily as auxiliary components within LSM trees, LearnedKV employs a two-tier design where the LSM tree handles recent write operations while a separate Learned Index accelerates read performance. Our design includes a non-blocking conversion mechanism that efficiently transforms LSM data into a Learned Index during garbage collection, maintaining high performance without interrupting operations. LearnedKV dramatically reduces LSM size through this tiered approach, leading to significant performance gains in both reads and writes. Extensive evaluations across diverse workloads show that LearnedKV outperforms state-of-the-art LSM-based solutions by up to 4.32x for read operations and 1.43x for writes. The system demonstrates robust performance across different data distributions, access patterns, and storage media including both SSDs and HDDs.

📄 PDF Abstract BibTeX arXiv:2406.18892

Code (0)

등록된 구현이 없습니다.

Tasks

Blocking

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
U-Net 설명 없음
SSDS The method exploits the finding that high correlation of segmentation performance among each U-Net's decoder layer -- with discriminative layer attached -- tends to have higher…

Similar Papers 제목 키워드 기반

Learned Indexes for a Google-scale Disk-based Database

2020-12-23 · Hussam Abu-Libdeh, Deniz Altınbüken, Alex Beutel, Ed H. Chi 외

There is great excitement about learned index structures, but understandable skepticism about the practicality of a new method uprooting decades of research on B-Trees. In this paper, we work to remove some of that uncer…

Learned Index with Dynamic $\epsilon$

2021-09-29 · Daoyuan Chen, Wuchao Li, Yaliang Li, Bolin Ding 외

Index structure is a fundamental component in database and facilitates broad data retrieval applications. Recent learned index methods show superior performance by learning hidden yet useful data distribution with the he…

Retrieval

A Learned Index for Exact Similarity Search in Metric Spaces

2022-04-21 · Yao Tian, Tingyun Yan, Xi Zhao, Kai Huang 외

Indexing is an effective way to support efficient query processing in large databases. Recently the concept of learned index, which replaces or complements traditional index structures with machine learning models, has b…

BIG-bench Machine Learning

LSI: A Learned Secondary Index Structure

2022-05-11 · Andreas Kipf, Dominik Horn, Pascal Pfeil, Ryan Marcus 외

Learned index structures have been shown to achieve favorable lookup performance and space consumption compared to their traditional counterparts such as B-trees. However, most learned index studies have focused on the p…

ALEX: An Updatable Adaptive Learned Index

2019-05-21 · Jialin Ding, Umar Farooq Minhas, JIA YU, Chi Wang 외

Recent work on "learned indexes" has changed the way we look at the decades-old field of DBMS indexing. The key idea is that indexes can be thought of as "models" that predict the position of a key in a dataset. Indexes …