paper-with-me

Papers

Learning Multi-dimensional Indexes

2019-12-03 · Vikram Nathan, Jialin Ding, Mohammad Alizadeh, Tim Kraska

Scanning and filtering over multi-dimensional tables are key operations in modern analytical database engines. To optimize the performance of these operations, databases often create clustered indexes over a single dimension or multi-dimensional indexes such as R-trees, or use complex sort orders (e.g., Z-ordering). However, these schemes are often hard to tune and their performance is inconsistent across different datasets and queries. In this paper, we introduce Flood, a multi-dimensional in-memory index that automatically adapts itself to a particular dataset and workload by jointly optimizing the index structure and data storage. Flood achieves up to three orders of magnitude faster performance for range scans with predicates than state-of-the-art multi-dimensional indexes or sort orders on real-world datasets and workloads. Our work serves as a building block towards an end-to-end learned database system.

📄 PDF Abstract BibTeX arXiv:1912.01668

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Survey of Learned Indexes for the Multi-dimensional Space

2024-03-11 · Abdullah Al-Mamun, Hao Wu, Qiyang He, Jianguo Wang 외

A recent research trend involves treating database index structures as Machine Learning (ML) models. In this domain, single or multiple ML models are trained to learn the mapping from keys to positions inside a data set.…

Survey

Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads

2020-06-23 · Jialin Ding, Vikram Nathan, Mohammad Alizadeh, Tim Kraska

Filtering data based on predicates is one of the most fundamental operations for any modern data warehouse. Techniques to accelerate the execution of filter expressions include clustered indexes, specialized sort orders …

Cortex: Harnessing Correlations to Boost Query Performance

2020-12-12 · Vikram Nathan, Jialin Ding, Tim Kraska, Mohammad Alizadeh

Databases employ indexes to filter out irrelevant records, which reduces scan overhead and speeds up query execution. However, this optimization is only available to queries that filter on the indexed attribute. To exten…

Attribute

Optimizing Data-driven Weights In Multidimensional Indexes

2025-04-08 · Lidia Ceriani, Chiara Gigliarano, Paolo Verme

Multidimensional indexes are ubiquitous, and popular, but present non-negligible normative choices when it comes to attributing weights to their dimensions. This paper provides a more rigorous approach to the choice of w…

The Case for Learned Spatial Indexes

2020-08-24 · Varun Pandey, Alexander van Renen, Andreas Kipf, Ibrahim Sabek 외

Spatial data is ubiquitous. Massive amounts of data are generated every day from billions of GPS-enabled devices such as cell phones, cars, sensors, and various consumer-based applications such as Uber, Tinder, location-…