paper-with-me

Papers

FOSS: A Self-Learned Doctor for Query Optimizer

2023-12-11 · Kai Zhong, Luming Sun, Tao Ji, Cuiping Li, Hong Chen

Various works have utilized deep learning to address the query optimization problem in database system. They either learn to construct plans from scratch in a bottom-up manner or steer the plan generation behavior of traditional optimizer using hints. While these methods have achieved some success, they face challenges in either low training efficiency or limited plan search space. To address these challenges, we introduce FOSS, a novel framework for query optimization based on deep reinforcement learning. FOSS initiates optimization from the original plan generated by a traditional optimizer and incrementally refines suboptimal nodes of the plan through a sequence of actions. Additionally, we devise an asymmetric advantage model to evaluate the advantage between two plans. We integrate it with a traditional optimizer to form a simulated environment. Leveraging this simulated environment, FOSS can bootstrap itself to rapidly generate a large amount of high-quality simulated experiences. FOSS then learns from these experiences to improve its optimization capability. We evaluate the performance of FOSS on Join Order Benchmark, TPC-DS, and Stack Overflow. The experimental results demonstrate that FOSS outperforms the state-of-the-art methods in terms of latency performance. Compared to PostgreSQL, FOSS achieves speedup ranging from 1.15x to 8.33x in total latency across different benchmarks.

📄 PDF Abstract BibTeX arXiv:2312.06357

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

Similar Papers 제목 키워드 기반

Doctor Recommendation in Online Health Forums via Expertise Learning

2022-03-06 · ACL 2022 5 · Xiaoxin Lu, Yubo Zhang, Jing Li, Shi Zong

Huge volumes of patient queries are daily generated on online health forums, rendering manual doctor allocation a labor-intensive task. To better help patients, this paper studies a novel task of doctor recommendation to…

Self-Learning

GenJoin: Conditional Generative Plan-to-Plan Query Optimizer that Learns from Subplan Hints

2024-11-07 · Pavel Sulimov, Claude Lehmann, Kurt Stockinger

Query optimization has become a research area where classical algorithms are being challenged by machine learning algorithms. At the same time, recent trends in learned query optimizers have shown that it is prudent to t…

RELOAD: A Robust and Efficient Learned Query Optimizer for Database Systems

2026-04-16 · Seokwon Lee, Jaeyoung Sim, Sihyun Kim, Yuhsing Li 외 arxiv

Recent advances in query optimization have shifted from traditional rule-based and cost-based techniques towards machine learning-driven approaches. Among these, reinforcement learning (RL) has attracted significant atte…

Reinforcement Learning

Lero: A Learning-to-Rank Query Optimizer

2023-02-14 · Rong Zhu, Wei Chen, Bolin Ding, Xingguang Chen 외

A recent line of works apply machine learning techniques to assist or rebuild cost-based query optimizers in DBMS. While exhibiting superiority in some benchmarks, their deficiencies, e.g., unstable performance, high tra…

Binary ClassificationLearning-To-Rank

Training Learned Optimizers with Randomly Initialized Learned Optimizers

2021-01-14 · Luke Metz, C. Daniel Freeman, Niru Maheswaranathan, Jascha Sohl-Dickstein

Learned optimizers are increasingly effective, with performance exceeding that of hand designed optimizers such as Adam~\citep{kingma2014adam} on specific tasks \citep{metz2019understanding}. Despite the potential gains …