paper-with-me

Papers

Sig2Model: A Boosting-Driven Model for Updatable Learned Indexes

2025-09-25 · Alireza Heidari, Amirhossein Ahmad, Wei Zhang, Ying Xiong arxiv

Learned Indexes (LIs) represent a paradigm shift from traditional index structures by employing machine learning models to approximate the cumulative distribution function (CDF) of sorted data. While LIs achieve remarkable efficiency for static datasets, their performance degrades under dynamic updates: maintaining the CDF invariant (sum of F(k) equals 1) requires global model retraining, which blocks queries and limits the queries-per-second (QPS) metric. Current approaches fail to address these retraining costs effectively, rendering them unsuitable for real-world workloads with frequent updates. In this paper, we present Sig2Model, an efficient and adaptive learned index that minimizes retraining cost through three key techniques: (1) a sigmoid boosting approximation technique that dynamically adjusts the index model by approximating update-induced shifts in data distribution with localized sigmoid functions while preserving bounded error guarantees and deferring full retraining; (2) proactive update training via Gaussian mixture models (GMMs) that identifies high-update-probability regions for strategic placeholder allocation to speed up updates; and (3) a neural joint optimization framework that continuously refines both the sigmoid ensemble and GMM parameters via gradient-based learning. We evaluate Sig2Model against state-of-the-art updatable learned indexes on real-world and synthetic workloads, and show that Sig2Model reduces retraining cost by up to 20x, achieves up to 3x higher QPS, and uses up to 1000x less memory.

📄 PDF Abstract BibTeX arXiv:2509.20781

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

About a structure of easily updatable full-text indexes

2020-07-18 · Alexander B. Veretennikov

We consider strategies to organize easily updatable associative arrays in external memory. These arrays are used for full-text search. We study indexes with different keys: single word form, two word forms, and sequences…

ALEX: An Updatable Adaptive Learned Index

2019-05-21 · Jialin Ding, Umar Farooq Minhas, JIA YU, Chi Wang 외

Recent work on "learned indexes" has changed the way we look at the decades-old field of DBMS indexing. The key idea is that indexes can be thought of as "models" that predict the position of a key in a dataset. Indexes …

CARMI: A Cache-Aware Learned Index with a Cost-based Construction Algorithm

2021-03-01 · Jiaoyi Zhang, Yihan Gao

Learned indexes, which use machine learning models to replace traditional index structures, have shown promising results in recent studies. However, existing learned indexes exhibit a performance gap between synthetic an…

CPU

UpLIF: An Updatable Self-Tuning Learned Index Framework

2024-08-07 · Alireza Heidari, Amirhossein Ahmadi, Wei zhang

The emergence of learned indexes has caused a paradigm shift in our perception of indexing by considering indexes as predictive models that estimate keys' positions within a data set, resulting in notable improvements in…

A Pluggable Learned Index Method via Sampling and Gap Insertion

2021-01-04 · Yaliang Li, Daoyuan Chen, Bolin Ding, Kai Zeng 외

Database indexes facilitate data retrieval and benefit broad applications in real-world systems. Recently, a new family of index, named learned index, is proposed to learn hidden yet useful data distribution and incorpor…

BIG-bench Machine LearningRetrieval