paper-with-me

Papers

LOOPer: A Learned Automatic Code Optimizer For Polyhedral Compilers

2024-03-18 · Massinissa Merouani, Khaled Afif Boudaoud, Iheb Nassim Aouadj, Nassim Tchoulak, Islem Kara Bernou, Hamza Benyamina, Fatima Benbouzid-Si Tayeb, Karima Benatchba, Hugh Leather, Riyadh Baghdadi

While polyhedral compilers have shown success in implementing advanced code transformations, they still face challenges in selecting the ones that lead to the most profitable speedups. This has motivated the use of machine learning based cost models to guide the search for polyhedral optimizations. State-of-the-art polyhedral compilers have demonstrated a viable proof-of-concept of such an approach. While promising, this approach still faces significant limitations. State-of-the-art polyhedral compilers that use a deep learning cost model only support a small subset of affine transformations, limiting their ability to explore complex code transformations. Furthermore, their applicability does not scale beyond simple programs, thus excluding many program classes from their scope, such as those with non-rectangular iteration domains or multiple loop nests. These limitations significantly impact the generality of such compilers and autoschedulers and put into question the whole approach. In this paper, we introduce LOOPer, the first polyhedral autoscheduler that uses a deep learning based cost model and covers a large space of affine transformations and programs. LOOPer allows the optimization of an extensive set of programs while being effective at applying complex sequences of polyhedral transformations. We implement and evaluate LOOPer and show that it achieves competitive speedups over the state-of-the-art. On the PolyBench benchmarks, LOOPer achieves a geometric mean speedup of 1.84x over Tiramisu and 1.42x over Pluto, two state-of-the-art polyhedral autoschedulers.

📄 PDF Abstract BibTeX arXiv:2403.11522

Code (1)

tiramisu-compiler/cost_model_pretrain pytorch

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
NesT NesT stacks canonical transformer layers to conduct local self-attention on every image block independently, and then "nests" them hierarchically. Coupling of processed…

Similar Papers 제목 키워드 기반

LOOPerSet: A Large-Scale Dataset for Data-Driven Polyhedral Compiler Optimization

2025-10-11 · Massinissa Merouani, Afif Boudaoud, Riyadh Baghdadi arxiv

The advancement of machine learning for compiler optimization, particularly within the polyhedral model, is constrained by the scarcity of large-scale, public performance datasets. This data bottleneck forces researchers…

LooperMuscle: Fast and Stable Learning of Humanoid Whole-Body Tracking via Structured Mixture-of-Experts

2026-08-01 · Boyi Liu, Qijin Li, Tianqi Yu, Qinrui Yan 외 arxiv

FastSAC-style methods significantly reduce humanoid motion training time but often suffer from notable performance degradation compared with PPO in whole-body tracking tasks. We target this speed-performance gap by intro…

Looper: An end-to-end ML platform for product decisions

2021-10-14 · Igor L. Markov, Hanson Wang, Nitya Kasturi, Shaun Singh 외

Modern software systems and products increasingly rely on machine learning models to make data-driven decisions based on interactions with users, infrastructure and other systems. For broader adoption, this practice must…

Decision Making

VeLO: Training Versatile Learned Optimizers by Scaling Up

2022-11-17 · Luke Metz, James Harrison, C. Daniel Freeman, Amil Merchant 외

While deep learning models have replaced hand-designed features across many domains, these models are still trained with hand-designed optimizers. In this work, we leverage the same scaling approach behind the success of…

Deep Learning

Overcoming barriers to the training of effective learned optimizers

2021-01-01 · Luke Metz, Niru Maheswaranathan, C. Daniel Freeman, Ben Poole 외

Much as replacing hand-designed features with learned functions has revolutionized how we solve perceptual tasks, we believe learned algorithms will transform how we train models. In this work we focus on general-purpose…