IA2: Leveraging Instance-Aware Index Advisor with Reinforcement Learning for Diverse Workloads

2024-04-08 · Taiyi Wang, Eiko Yoneki

This study introduces the Instance-Aware Index Advisor (IA2), a novel deep reinforcement learning (DRL)-based approach for optimizing index selection in databases facing large action spaces of potential candidates. IA2 introduces the Twin Delayed Deep Deterministic Policy Gradient - Temporal Difference State-Wise Action Refinery (TD3-TD-SWAR) model, enabling efficient index selection by understanding workload-index dependencies and employing adaptive action masking. This method includes a comprehensive workload model, enhancing its ability to adapt to unseen workloads and ensuring robust performance across diverse database environments. Evaluation on benchmarks such as TPC-H reveals IA2's suggested indexes' performance in enhancing runtime, securing a 40% reduction in runtime for complex TPC-H workloads compared to scenarios without indexes, and delivering a 20% improvement over existing state-of-the-art DRL-based index advisors.

📄 PDF Abstract BibTeX arXiv:2404.05777

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learning

AutoIndexer: A Reinforcement Learning-Enhanced Index Advisor Towards Scaling Workloads

2025-07-30 · Taiyi Wang, Eiko Yoneki arxiv

Efficiently selecting indexes is fundamental to database performance optimization, particularly for systems handling large-scale analytical workloads. While deep reinforcement learning (DRL) has shown promise in automati…

Reinforcement Learning

The Case for Automatic Database Administration using Deep Reinforcement Learning

2018-01-17 · Ankur Sharma, Felix Martin Schuhknecht, Jens Dittrich

Like any large software system, a full-fledged DBMS offers an overwhelming amount of configuration knobs. These range from static initialisation parameters like buffer sizes, degree of concurrency, or level of replicatio…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Learning from Multiple Independent Advisors in Multi-agent Reinforcement Learning

2023-01-26 · Sriram Ganapathi Subramanian, Matthew E. Taylor, Kate Larson, Mark Crowley

Multi-agent reinforcement learning typically suffers from the problem of sample inefficiency, where learning suitable policies involves the use of many data samples. Learning from external demonstrators is a possible sol…

Multi-agent Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning+1

Temporal Transfer Learning for Traffic Optimization with Coarse-grained Advisory Autonomy

2023-11-27 · Jung-Hoon Cho, Sirui Li, Jeongyun Kim, Cathy Wu

The recent development of connected and automated vehicle (CAV) technologies has spurred investigations to optimize dense urban traffic to maximize vehicle speed and throughput. This paper explores advisory autonomy, in …

Deep Reinforcement Learning Reinforcement Learning (RL)Transfer Learning

PALCAS: A Priority-Aware Intelligent Lane Change Advisory System for Autonomous Vehicles using Federated Reinforcement Learning

2026-04-29 · Yassine Ibork, Nhat Ha Nguyen, Myounggyu Won, Lokesh Das arxiv

We present a priority-aware intelligent lane change advisory system based on multi-agent federated reinforcement learning, namely PALCAS, for autonomous vehicles (AVs). While existing lane-change approaches typically foc…

Reinforcement Learning Autonomous Vehicles