ML$^2$Tuner: Efficient Code Tuning via Multi-Level Machine Learning Models
The increasing complexity of deep learning models necessitates specialized hardware and software optimizations, particularly for deep learning accelerators. Existing autotuning methods often suffer from prolonged tuning times due to profiling invalid configurations, which can cause runtime errors. We introduce ML$^2$Tuner, a multi-level machine learning tuning technique that enhances autotuning efficiency by incorporating a validity prediction model to filter out invalid configurations and an advanced performance prediction model utilizing hidden features from the compilation process. Experimental results on an extended VTA accelerator demonstrate that ML$^2$Tuner achieves equivalent performance improvements using only 12.3% of the samples required with a similar approach as TVM and reduces invalid profiling attempts by an average of 60.8%, Highlighting its potential to enhance autotuning performance by filtering out invalid configurations
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningSimilar Papers 제목 키워드 기반
VDTuner: Automated Performance Tuning for Vector Data Management Systems
Vector data management systems (VDMSs) have become an indispensable cornerstone in large-scale information retrieval and machine learning systems like large language models. To enhance the efficiency and flexibility of s…
Bayesian OptimizationInformation RetrievalManagementAutotuning Search Space for Loop Transformations
One of the challenges for optimizing compilers is to predict whether applying an optimization will improve its execution speed. Programmers may override the compiler's profitability heuristic using optimization directive…
Multitask and Transfer Learning for Autotuning Exascale Applications
Multitask learning and transfer learning have proven to be useful in the field of machine learning when additional knowledge is available to help a prediction task. We aim at deriving methods following these paradigms fo…
Transfer LearningMLtuner: System Support for Automatic Machine Learning Tuning
MLtuner automatically tunes settings for training tunables (such as the learning rate, the momentum, the mini-batch size, and the data staleness bound) that have a significant impact on large-scale machine learning (ML) …
BIG-bench Machine LearningGeneral Classificationimage-classificationImage Classification+1Cloud Database Tuning with Reinforcement Learning
In database management systems (DBMSs), especially cloud DBMSs, configuration tuning is one of the key factors that influence database performance. For a long period of time, the tuning job of databases is done by experi…
Managementreinforcement-learningReinforcement LearningReinforcement Learning (RL)