paper-with-me

홈 › Papers

Learning Key-Value Store Design

2019-07-11 · Stratos Idreos, Niv Dayan, Wilson Qin, Mali Akmanalp, Sophie Hilgard, Andrew Ross, James Lennon, Varun Jain, Harshita Gupta, David Li, Zichen Zhu

We introduce the concept of design continuums for the data layout of key-value stores. A design continuum unifies major distinct data structure designs under the same model. The critical insight and potential long-term impact is that such unifying models 1) render what we consider up to now as fundamentally different data structures to be seen as views of the very same overall design space, and 2) allow seeing new data structure designs with performance properties that are not feasible by existing designs. The core intuition behind the construction of design continuums is that all data structures arise from the very same set of fundamental design principles, i.e., a small set of data layout design concepts out of which we can synthesize any design that exists in the literature as well as new ones. We show how to construct, evaluate, and expand, design continuums and we also present the first continuum that unifies major data structure designs, i.e., B+tree, B-epsilon-tree, LSM-tree, and LSH-table. The practical benefit of a design continuum is that it creates a fast inference engine for the design of data structures. For example, we can predict near instantly how a specific design change in the underlying storage of a data system would affect performance, or reversely what would be the optimal data structure (from a given set of designs) given workload characteristics and a memory budget. In turn, these properties allow us to envision a new class of self-designing key-value stores with a substantially improved ability to adapt to workload and hardware changes by transitioning between drastically different data structure designs to assume a diverse set of performance properties at will.

📄 PDF Abstract BibTeX arXiv:1907.05443

Code (0)

등록된 구현이 없습니다.

Tasks

Layout Design

Similar Papers 제목 키워드 기반

Learning to Optimize LSM-trees: Towards A Reinforcement Learning based Key-Value Store for Dynamic Workloads

2023-08-14 · Dingheng Mo, Fanchao Chen, Siqiang Luo, Caihua Shan

LSM-trees are widely adopted as the storage backend of key-value stores. However, optimizing the system performance under dynamic workloads has not been sufficiently studied or evaluated in previous work. To fill the gap…

Reinforcement Learning (RL)

Learned Static Function Data Structures

2025-10-31 · Stefan Hermann, Hans-Peter Lehmann, Giorgio Vinciguerra, Stefan Walzer arxiv

We consider the task of constructing a data structure for associating a static set of keys with values, while allowing arbitrary output values for queries involving keys outside the set. Compared to hash tables, these so…

Differentially Private Datastore Generation for Retrieval-Augmented Inference

2026-05-31 · Abdelrahman Abouelenein, Marwan Torki arxiv

It is crucial for modern on-device AI systems that rely on retrieval-augmented inference to release and share datastores without compromising individual privacy. This can be achieved using Differential Privacy (DP), whic…

Consistency Analysis of Replication-Based Probabilistic Key-Value Stores

2020-02-14 · Ramy E. Ali

Partial quorum systems are widely used in distributed key-value stores due to their latency benefits at the expense of providing weaker consistency guarantees. The probabilistically bounded staleness framework (PBS) stud…

RestoreFormer: High-Quality Blind Face Restoration from Undegraded Key-Value Pairs

2022-01-17 · CVPR 2022 1 · Zhouxia Wang, Jiawei Zhang, Runjian Chen, Wenping Wang 외

Blind face restoration is to recover a high-quality face image from unknown degradations. As face image contains abundant contextual information, we propose a method, RestoreFormer, which explores fully-spatial attention…

Blind Face RestorationFace ReconstructionVocal Bursts Intensity Prediction