Balsa: Learning a Query Optimizer Without Expert Demonstrations
Query optimizers are a performance-critical component in every database system. Due to their complexity, optimizers take experts months to write and years to refine. In this work, we demonstrate for the first time that learning to optimize queries without learning from an expert optimizer is both possible and efficient. We present Balsa, a query optimizer built by deep reinforcement learning. Balsa first learns basic knowledge from a simple, environment-agnostic simulator, followed by safe learning in real execution. On the Join Order Benchmark, Balsa matches the performance of two expert query optimizers, both open-source and commercial, with two hours of learning, and outperforms them by up to 2.8$\times$ in workload runtime after a few more hours. Balsa thus opens the possibility of automatically learning to optimize in future compute environments where expert-designed optimizers do not exist.
Code (1)
Tasks
Deep Reinforcement LearningSimilar Papers 제목 키워드 기반
Bayesian Active Learning By Distribution Disagreement
Active Learning (AL) for regression has been systematically under-researched due to the increased difficulty of measuring uncertainty in regression models. Since normalizing flows offer a full predictive distribution ins…
Active LearningregressionUncertainty QuantificationRELOAD: A Robust and Efficient Learned Query Optimizer for Database Systems
Recent advances in query optimization have shifted from traditional rule-based and cost-based techniques towards machine learning-driven approaches. Among these, reinforcement learning (RL) has attracted significant atte…
Reinforcement LearningAdaptive Transmission Scheduling in Wireless Networks for Asynchronous Federated Learning
In this paper, we study asynchronous federated learning (FL) in a wireless distributed learning network (WDLN). To allow each edge device to use its local data more efficiently via asynchronous FL, transmission schedulin…
Federated LearningScheduling"Give Me an Example Like This": Episodic Active Reinforcement Learning from Demonstrations
Reinforcement Learning (RL) has achieved great success in sequential decision-making problems, but often at the cost of a large number of agent-environment interactions. To improve sample efficiency, methods like Reinfor…
Active LearningReinforcement Learning (RL)Sequential Decision MakingTowards an Adaptable and Generalizable Optimization Engine in Decision and Control: A Meta Reinforcement Learning Approach
Sampling-based model predictive control (MPC) has found significant success in optimal control problems with non-smooth system dynamics and cost function. Many machine learning-based works proposed to improve MPC by a) l…
Decision MakingImitation LearningMeta Reinforcement LearningModel Predictive Control+2