paper-with-me

홈 › Papers

Theoretical Analysis of Learned Database Operations under Distribution Shift through Distribution Learnability

2024-11-09 · Sepanta Zeighami, Cyrus Shahahbi

Use of machine learning to perform database operations, such as indexing, cardinality estimation, and sorting, is shown to provide substantial performance benefits. However, when datasets change and data distribution shifts, empirical results also show performance degradation for learned models, possibly to worse than non-learned alternatives. This, together with a lack of theoretical understanding of learned methods undermines their practical applicability, since there are no guarantees on how well the models will perform after deployment. In this paper, we present the first known theoretical characterization of the performance of learned models in dynamic datasets, for the aforementioned operations. Our results show novel theoretical characteristics achievable by learned models and provide bounds on the performance of the models that characterize their advantages over non-learned methods, showing why and when learned models can outperform the alternatives. Our analysis develops the distribution learnability framework and novel theoretical tools which build the foundation for the analysis of learned database operations in the future.

📄 PDF Abstract BibTeX arXiv:2411.06241

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Towards Establishing Guaranteed Error for Learned Database Operations

2024-11-09 · Sepanta Zeighami, Cyrus Shahabi

Machine learning models have demonstrated substantial performance enhancements over non-learned alternatives in various fundamental data management operations, including indexing (locating items in an array), cardinality…

Attribute

In-Context Adaptation to Concept Drift for Learned Database Operations

2025-05-07 · Jiaqi Zhu, Shaofeng Cai, Yanyan Shen, Gang Chen 외

Machine learning has demonstrated transformative potential for database operations, such as query optimization and in-database data analytics. However, dynamic database environments, characterized by frequent updates and…

Piecewise Linear Approximation in Learned Index Structures: Theoretical and Empirical Analysis

2025-06-25 · Jiayong Qin, Xianyu Zhu, Qiyu Liu, Guangyi Zhang 외

A growing trend in the database and system communities is to augment conventional index structures, such as B+-trees, with machine learning (ML) models. Among these, error-bounded Piecewise Linear Approximation ($\epsilo…

Learning Multi-dimensional Indexes

2019-12-03 · Vikram Nathan, Jialin Ding, Mohammad Alizadeh, Tim Kraska

Scanning and filtering over multi-dimensional tables are key operations in modern analytical database engines. To optimize the performance of these operations, databases often create clustered indexes over a single dimen…

Retinal vessel segmentation based on Fully Convolutional Neural Networks

2018-12-18 · Américo Oliveira, Sérgio Pereira, Carlos A. Silva

The retinal vascular condition is a reliable biomarker of several ophthalmologic and cardiovascular diseases, so automatic vessel segmentation may be crucial to diagnose and monitor them. In this paper, we propose a nove…

Data AugmentationRetinal Vessel SegmentationSegmentation