paper-with-me

Papers

TIRAMISU: A Polyhedral Compiler for Dense and Sparse Deep Learning

2020-05-07 · Riyadh Baghdadi, Abdelkader Nadir Debbagh, Kamel Abdous, Fatima Zohra Benhamida, Alex Renda, Jonathan Elliott Frankle, Michael Carbin, Saman Amarasinghe

In this paper, we demonstrate a compiler that can optimize sparse and recurrent neural networks, both of which are currently outside of the scope of existing neural network compilers (sparse neural networks here stand for networks that can be accelerated with sparse tensor algebra techniques). Our demonstration includes a mapping of sparse and recurrent neural networks to the polyhedral model along with an implementation of our approach in TIRAMISU, our state-of-the-art polyhedral compiler. We evaluate our approach on a set of deep learning benchmarks and compare our results with hand-optimized industrial libraries. Our results show that our approach at least matches Intel MKL-DNN and in some cases outperforms it by 5x (on multicore-CPUs).

📄 PDF Abstract BibTeX arXiv:2005.04091

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Learningtensor algebra

Similar Papers 제목 키워드 기반

Tiramisu: A Polyhedral Compiler for Expressing Fast and Portable Code

2018-04-27 · Riyadh Baghdadi, Jessica Ray, Malek Ben Romdhane, Emanuele Del Sozzo 외

This paper introduces Tiramisu, a polyhedral framework designed to generate high performance code for multiple platforms including multicores, GPUs, and distributed machines. Tiramisu introduces a scheduling language wit…

Scheduling

LOOPer: A Learned Automatic Code Optimizer For Polyhedral Compilers

2024-03-18 · Massinissa Merouani, Khaled Afif Boudaoud, Iheb Nassim Aouadj, Nassim Tchoulak 외

While polyhedral compilers have shown success in implementing advanced code transformations, they still face challenges in selecting the ones that lead to the most profitable speedups. This has motivated the use of machi…

Compressing Structured Tensor Algebra

2024-07-18 · Mahdi Ghorbani, Emilien Bauer, Tobias Grosser, Amir Shaikhha

Tensor algebra is a crucial component for data-intensive workloads such as machine learning and scientific computing. As the complexity of data grows, scientists often encounter a dilemma between the highly specialized d…

Code Generationtensor algebra

A Deep Learning Based Cost Model for Automatic Code Optimization

2021-04-11 · Riyadh Baghdadi, Massinissa Merouani, Mohamed-Hicham Leghettas, Kamel Abdous 외

Enabling compilers to automatically optimize code has been a longstanding goal for the compiler community. Efficiently solving this problem requires using precise cost models. These models predict whether applying a sequ…

Deep LearningFeature Engineering

Using Deep Neural Networks for Estimating Loop Unrolling Factor

2019-11-10 · Asma Balamane, Zina Taklit

Optimizing programs requires deep expertise. On one hand, it is a tedious task, because it requires a lot of tests to find out the best combination of optimizations to apply with their best factors. On the other hand, th…

Rolling Shutter CorrectionScheduling