paper-with-me

홈 › Papers

Power Constrained Autotuning using Graph Neural Networks

2023-02-22 · Akash Dutta, Jee Choi, Ali Jannesari

Recent advances in multi and many-core processors have led to significant improvements in the performance of scientific computing applications. However, the addition of a large number of complex cores have also increased the overall power consumption, and power has become a first-order design constraint in modern processors. While we can limit power consumption by simply applying software-based power constraints, applying them blindly will lead to non-trivial performance degradation. To address the challenge of improving the performance, power, and energy efficiency of scientific applications on modern multi-core processors, we propose a novel Graph Neural Network based auto-tuning approach that (i) optimizes runtime performance at pre-defined power constraints, and (ii) simultaneously optimizes for runtime performance and energy efficiency by minimizing the energy-delay product. The key idea behind this approach lies in modeling parallel code regions as flow-aware code graphs to capture both semantic and structural code features. We demonstrate the efficacy of our approach by conducting an extensive evaluation on $30$ benchmarks and proxy-/mini-applications with $68$ OpenMP code regions. Our approach identifies OpenMP configurations at different power constraints that yield a geometric mean performance improvement of more than $25\%$ and $13\%$ over the default OpenMP configuration on a 32-core Skylake and a $16$-core Haswell processor respectively. In addition, when we optimize for the energy-delay product, the OpenMP configurations selected by our auto-tuner demonstrate both performance improvement of $21\%$ and $11\%$ and energy reduction of $29\%$ and $18\%$ over the default OpenMP configuration at Thermal Design Power for the same Skylake and Haswell processors, respectively.

📄 PDF Abstract BibTeX arXiv:2302.11467

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural Network

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

ytopt: Autotuning Scientific Applications for Energy Efficiency at Large Scales

2023-03-28 · Xingfu Wu, Prasanna Balaprakash, Michael Kruse, Jaehoon Koo 외

As we enter the exascale computing era, efficiently utilizing power and optimizing the performance of scientific applications under power and energy constraints has become critical and challenging. We propose a low-overh…

Bayesian Optimization

FOGA: Flag Optimization with Genetic Algorithm

2021-05-15 · Burak Tağtekin, Berkan Höke, Mert Kutay Sezer, Mahiye Uluyağmur Öztürk

Recently, program autotuning has become very popular especially in embedded systems, when we have limited resources such as computing power and memory where these systems run generally time-critical applications. Compile…

Compiler OptimizationPosition

CATBench: A Compiler Autotuning Benchmarking Suite for Black-box Optimization

2024-06-24 · Jacob O. Tørring, Carl Hvarfner, Luigi Nardi, Magnus Själander

Bayesian optimization is a powerful method for automating tuning of compilers. The complex landscape of autotuning provides a myriad of rarely considered structural challenges for black-box optimizers, and the lack of st…

Bayesian OptimizationBenchmarkingCompiler Optimizationtensor algebra

Autotuning PolyBench Benchmarks with LLVM Clang/Polly Loop Optimization Pragmas Using Bayesian Optimization (extended version)

2021-04-27 · Xingfu Wu, Michael Kruse, Prasanna Balaprakash, Hal Finkel 외

In this paper, we develop a ytopt autotuning framework that leverages Bayesian optimization to explore the parameter space search and compare four different supervised learning methods within Bayesian optimization and ev…

Bayesian Optimization

Transfer-Learning-Based Autotuning Using Gaussian Copula

2024-01-09 · Thomas Randall, Jaehoon Koo, Brice Videau, Michael Kruse 외

As diverse high-performance computing (HPC) systems are built, many opportunities arise for applications to solve larger problems than ever before. Given the significantly increased complexity of these HPC systems and ap…

Transfer Learning