paper-with-me

Papers

HERO: Hint-Based Efficient and Reliable Query Optimizer

2024-12-03 · Sergey Zinchenko, Sergey Iazov

We propose a novel model for learned query optimization which provides query hints leading to better execution plans. The model addresses the three key challenges in learned hint-based query optimization: reliable hint recommendation (ensuring non-degradation of query latency), efficient hint exploration, and fast inference. We provide an in-depth analysis of existing NN-based approaches to hint-based optimization and experimentally confirm the named challenges for them. Our alternative solution consists of a new inference schema based on an ensemble of context-aware models and a graph storage for reliable hint suggestion and fast inference, and a budget-controlled training procedure with a local search algorithm that solves the issue of exponential search space exploration. In experiments on standard benchmarks, our model demonstrates optimization capability close to the best achievable with coarse-grained hints. Controlling the degree of parallelism (query dop) in addition to operator-related hints enables our model to achieve 3x latency improvement on JOB benchmark which sets a new standard for optimization. Our model is interpretable and easy to debug, which is particularly important for deployment in production.

📄 PDF Abstract BibTeX arXiv:2412.02372

Code (2)

zinchse/hbo_bench 공식 구현 pytorch
zinchse/hero 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

HINT An unsupervised approach for identifying Hierarchical Information Threads by analysing the network of related articles in a collection. In particular, HINT leverages article…

Similar Papers 제목 키워드 기반

GenJoin: Conditional Generative Plan-to-Plan Query Optimizer that Learns from Subplan Hints

2024-11-07 · Pavel Sulimov, Claude Lehmann, Kurt Stockinger

Query optimization has become a research area where classical algorithms are being challenged by machine learning algorithms. At the same time, recent trends in learned query optimizers have shown that it is prudent to t…

LLM4Hint: Leveraging Large Language Models for Hint Recommendation in Offline Query Optimization

2025-07-04 · Suchen Liu, Jun Gao, Yinjun Han, Yang Lin arxiv

Query optimization is essential for efficient SQL query execution in DBMS, and remains attractive over time due to the growth of data volumes and advances in hardware. Existing traditional optimizers struggle with the cu…

Training-Free Query Optimization via LLM-Based Plan Similarity

2025-06-06 · Nikita Vasilenko, Alexander Demin, Vladimir Boorlakov

Large language model (LLM) embeddings offer a promising new avenue for database query optimization. In this paper, we explore how pre-trained execution plan embeddings can guide SQL query execution without the need for a…

Language ModelingLanguage ModellingLarge Language Model

A Learned Cost Model-based Cross-engine Optimizer for SQL Workloads

2025-06-03 · András Strausz, Niels Pardon, Ioana Giurgiu

Lakehouse systems enable the same data to be queried with multiple execution engines. However, selecting the engine best suited to run a SQL query still requires a priori knowledge of the query computational requirements…

Multi-Task Learning

FOSS: A Self-Learned Doctor for Query Optimizer

2023-12-11 · Kai Zhong, Luming Sun, Tao Ji, Cuiping Li 외

Various works have utilized deep learning to address the query optimization problem in database system. They either learn to construct plans from scratch in a bottom-up manner or steer the plan generation behavior of tra…

Deep Reinforcement Learning