paper-with-me

홈 › Papers

Query2Vec: An Evaluation of NLP Techniques for Generalized Workload Analytics

2018-01-17 · Shrainik Jain, Bill Howe, Jiaqi Yan, Thierry Cruanes

We consider methods for learning vector representations of SQL queries to support generalized workload analytics tasks, including workload summarization for index selection and predicting queries that will trigger memory errors. We consider vector representations of both raw SQL text and optimized query plans, and evaluate these methods on synthetic and real SQL workloads. We find that general algorithms based on vector representations can outperform existing approaches that rely on specialized features. For index recommendation, we cluster the vector representations to compress large workloads with no loss in performance from the recommended index. For error prediction, we train a classifier over learned vectors that can automatically relate subtle syntactic patterns with specific errors raised during query execution. Surprisingly, we also find that these methods enable transfer learning, where a model trained on one SQL corpus can be applied to an unrelated corpus and still enable good performance. We find that these general approaches, when trained on a large corpus of SQL queries, provides a robust foundation for a variety of workload analysis tasks and database features, without requiring application-specific feature engineering.

📄 PDF Abstract BibTeX arXiv:1801.05613

Code (0)

등록된 구현이 없습니다.

Tasks

Feature EngineeringTransfer Learning

Similar Papers 제목 키워드 기반

Dynamic Data Layout Optimization with Worst-case Guarantees

2024-05-08 · Kexin Rong, Paul Liu, Sarah Ashok Sonje, Moses Charikar

Many data analytics systems store and process large datasets in partitions containing millions of rows. By mapping rows to partitions in an optimized way, it is possible to improve query performance by skipping over larg…

Sibyl: Forecasting Time-Evolving Query Workloads

2024-01-08 · Hanxian Huang, Tarique Siddiqui, Rana Alotaibi, Carlo Curino 외

Database systems often rely on historical query traces to perform workload-based performance tuning. However, real production workloads are time-evolving, making historical queries ineffective for optimizing future workl…

Decoder

Neural-based Modeling for Performance Tuning of Spark Data Analytics

2021-01-20 · Khaled Zaouk, Fei Song, Chenghao Lyu, Yanlei Diao

Cloud data analytics has become an integral part of enterprise business operations for data-driven insight discovery. Performance modeling of cloud data analytics is crucial for performance tuning and other critical oper…

Diversity

ReXCam: Resource-Efficient, Cross-Camera Video Analytics at Scale

2018-11-03 · Samvit Jain, Xun Zhang, Yuhao Zhou, Ganesh Ananthanarayanan 외

Enterprises are increasingly deploying large camera networks for video analytics. Many target applications entail a common problem template: searching for and tracking an object or activity of interest (e.g. a speeding v…

Adaptive Learning of Aggregate Analytics under Dynamic Workloads

2019-08-13 · Fotis Savva, Christos Anagnostopoulos, Peter Triantafillou

Large organizations have seamlessly incorporated data-driven decision making in their operations. However, as data volumes increase, expensive big data infrastructures are called to rescue. In this setting, analytics tas…

Decision Making