paper-with-me

홈 › Papers

NeuroCard: One Cardinality Estimator for All Tables

2020-06-15 · Zongheng Yang, Amog Kamsetty, Sifei Luan, Eric Liang, Yan Duan, Xi Chen, Ion Stoica

Query optimizers rely on accurate cardinality estimates to produce good execution plans. Despite decades of research, existing cardinality estimators are inaccurate for complex queries, due to making lossy modeling assumptions and not capturing inter-table correlations. In this work, we show that it is possible to learn the correlations across all tables in a database without any independence assumptions. We present NeuroCard, a join cardinality estimator that builds a single neural density estimator over an entire database. Leveraging join sampling and modern deep autoregressive models, NeuroCard makes no inter-table or inter-column independence assumptions in its probabilistic modeling. NeuroCard achieves orders of magnitude higher accuracy than the best prior methods (a new state-of-the-art result of 8.5$\times$ maximum error on JOB-light), scales to dozens of tables, while being compact in space (several MBs) and efficient to construct or update (seconds to minutes).

📄 PDF Abstract BibTeX arXiv:2006.08109

Code (1)

neurocard/neurocard 공식 구현 pytorch

Tasks

All

Similar Papers 제목 키워드 기반

Scardina: Scalable Join Cardinality Estimation by Multiple Density Estimators

2023-03-31 · Ryuichi Ito, Yuya Sasaki, Chuan Xiao, Makoto Onizuka

In recent years, machine learning-based cardinality estimation methods are replacing traditional methods. This change is expected to contribute to one of the most important applications of cardinality estimation, the que…

Forgetting by Pruning: Data Deletion in Join Cardinality Estimation

2025-11-25 · Chaowei He, Yuanjun Liu, Qingzhi Ma, Shenyuan Ren 외 arxiv

Machine unlearning in learned cardinality estimation (CE) systems presents unique challenges due to the complex distributional dependencies in multi-table relational data. Specifically, data deletion, a core component of…

QCardEst/QCardCorr: Quantum Cardinality Estimation and Correction

2025-09-10 · Tobias Winker, Jinghua Groppe, Sven Groppe arxiv

Cardinality estimation is an important part of query optimization in DBMS. We develop a Quantum Cardinality Estimation (QCardEst) approach using Quantum Machine Learning with a Hybrid Quantum-Classical Network. We define…

Quantum Machine Learning

Duet: efficient and scalable hybriD neUral rElation undersTanding

2023-07-25 · Kaixin Zhang, Hongzhi Wang, Yabin Lu, ZiQi Li 외

Learned cardinality estimation methods have achieved high precision compared to traditional methods. Among learned methods, query-driven approaches have faced the workload drift problem for a long time. Although both dat…

CPUGPURelation

Deep Unsupervised Cardinality Estimation

2019-05-10 · Zongheng Yang, Eric Liang, Amog Kamsetty, Chenggang Wu 외

Cardinality estimation has long been grounded in statistical tools for density estimation. To capture the rich multivariate distributions of relational tables, we propose the use of a new type of high-capacity statistica…

Density Estimation