paper-with-me

홈 › Papers

Powering In-Database Dynamic Model Slicing for Structured Data Analytics

2024-05-01 · Lingze Zeng, Naili Xing, Shaofeng Cai, Gang Chen, Beng Chin Ooi, Jian Pei, Yuncheng Wu

Relational database management systems (RDBMS) are widely used for the storage of structured data. To derive insights beyond statistical aggregation, we typically have to extract specific subdatasets from the database using conventional database operations, and then apply deep neural networks (DNN) training and inference on these subdatasets in a separate analytics system. The process can be prohibitively expensive, especially when there are various subdatasets extracted for different analytical purposes. This calls for efficient in-database support of advanced analytical methods. In this paper, we introduce LEADS, a novel SQL-aware dynamic model slicing technique to customize models for specified SQL queries. LEADS improves the predictive modeling of structured data via the mixture of experts (MoE) and maintains efficiency by a SQL-aware gating network. At the core of LEADS is the construction of a general model with multiple expert sub-models trained over the database. The MoE scales up the modeling capacity, enhances effectiveness, and preserves efficiency by activating necessary experts via the SQL-aware gating network during inference. To support in-database analytics, we build an inference extension that integrates LEADS onto PostgreSQL. Our extensive experiments on real-world datasets demonstrate that LEADS consistently outperforms the baseline models, and the in-database inference extension delivers a considerable reduction in inference latency compared to traditional solutions.

📄 PDF Abstract BibTeX arXiv:2405.00568

Code (0)

등록된 구현이 없습니다.

Tasks

Mixture-of-Experts

Methods 이 논문이 사용한 방법론

MoE 설명 없음

Similar Papers 제목 키워드 기반

AnDB: Breaking Boundaries with an AI-Native Database for Universal Semantic Analysis

2025-02-19 · Tianqing Wang, Xun Xue, Guoliang Li, Yong Wang

In this demonstration, we present AnDB, an AI-native database that supports traditional OLTP workloads and innovative AI-driven tasks, enabling unified semantic analysis across structured and unstructured data. While str…

Semantic RetrievalText to SQLText-To-SQL

Change Is the Only Constant: Dynamic LLM Slicing based on Layer Redundancy

2024-11-05 · Razvan-Gabriel Dumitru, Paul-Ioan Clotan, Vikas Yadav, Darius Peteleaza 외

This paper introduces a novel model compression approach through dynamic layer-specific pruning in Large Language Models (LLMs), enhancing the traditional methodology established by SliceGPT. By transitioning from consta…

Model Compression

AI-driven Orchestration at Scale: Estimating Service Metrics on National-Wide Testbeds

2025-07-21 · Rodrigo Moreira, Rafael Pasquini, Joberto S. B. Martins, Tereza C. Carvalho 외 arxiv

Network Slicing (NS) realization requires AI-native orchestration architectures to efficiently and intelligently handle heterogeneous user requirements. To achieve this, network slicing is evolving towards a more user-ce…

Deep Reinforcement Learning for Adaptive Network Slicing in 5G for Intelligent Vehicular Systems and Smart Cities

2020-10-19 · Almuthanna Nassar, Yasin Yilmaz

Intelligent vehicular systems and smart city applications are the fastest growing Internet of things (IoT) implementations at a compound annual growth rate of 30%. In view of the recent advances in IoT devices and the em…

Deep Reinforcement Learning

Dynamic RAN Slicing for Service-Oriented Vehicular Networks via Constrained Learning

2020-12-03 · Wen Wu, Nan Chen, Conghao Zhou, Mushu Li 외

In this paper, we investigate a radio access network (RAN) slicing problem for Internet of vehicles (IoV) services with different quality of service (QoS) requirements, in which multiple logically-isolated slices are con…

Reinforcement Learning (RL)