paper-with-me

홈 › Papers

Data-Driven Offline Optimization For Architecting Hardware Accelerators

2021-10-20 · ICLR 2022 4 · Aviral Kumar, Amir Yazdanbakhsh, Milad Hashemi, Kevin Swersky, Sergey Levine

Industry has gradually moved towards application-specific hardware accelerators in order to attain higher efficiency. While such a paradigm shift is already starting to show promising results, designers need to spend considerable manual effort and perform a large number of time-consuming simulations to find accelerators that can accelerate multiple target applications while obeying design constraints. Moreover, such a "simulation-driven" approach must be re-run from scratch every time the set of target applications or design constraints change. An alternative paradigm is to use a "data-driven", offline approach that utilizes logged simulation data, to architect hardware accelerators, without needing any form of simulations. Such an approach not only alleviates the need to run time-consuming simulation, but also enables data reuse and applies even when set of target applications changes. In this paper, we develop such a data-driven offline optimization method for designing hardware accelerators, dubbed PRIME, that enjoys all of these properties. Our approach learns a conservative, robust estimate of the desired cost function, utilizes infeasible points, and optimizes the design against this estimate without any additional simulator queries during optimization. PRIME architects accelerators -- tailored towards both single and multiple applications -- improving performance upon state-of-the-art simulation-driven methods by about 1.54x and 1.20x, while considerably reducing the required total simulation time by 93% and 99%, respectively. In addition, PRIME also architects effective accelerators for unseen applications in a zero-shot setting, outperforming simulation-based methods by 1.26x.

📄 PDF Abstract BibTeX arXiv:2110.11346

Code (1)

google-research/google-research/tree/master/prime 공식 구현 jax

Tasks

Computer Architecture and Systems

Similar Papers 제목 키워드 기반

Rearchitecting Datacenter Lifecycle for AI: A TCO-Driven Framework

2025-09-30 · Jovan Stojkovic, Chaojie Zhang, Íñigo Goiri, Ricardo Bianchini arxiv

The rapid rise of large language models (LLMs) has been driving an enormous demand for AI inference infrastructure, mainly powered by high-end GPUs. While these accelerators offer immense computational power, they incur …

Towards Human-Bot Collaborative Software Architecting with ChatGPT

2023-02-26 · Aakash Ahmad, Muhammad Waseem, Peng Liang, Mahdi Fehmideh 외

Architecting software-intensive systems can be a complex process. It deals with the daunting tasks of unifying stakeholders' perspectives, designers' intellect, tool-based automation, pattern-driven reuse, and so on, to …

DevFormer: A Symmetric Transformer for Context-Aware Device Placement

2022-05-26 · Haeyeon Kim, Minsu Kim, Federico Berto, Joungho Kim 외

In this paper, we present DevFormer, a novel transformer-based architecture for addressing the complex and computationally demanding problem of hardware design optimization. Despite the demonstrated efficacy of transform…

Combinatorial OptimizationMeta-Learning

Software Architecture for ML-based Systems: What Exists and What Lies Ahead

2021-03-14 · Henry Muccini, Karthik Vaidhyanathan

The increasing usage of machine learning (ML) coupled with the software architectural challenges of the modern era has resulted in two broad research areas: i) software architecture for ML-based systems, which focuses on…

Architecting Safer Autonomous Aviation Systems

2023-01-09 · Jane Fenn, Mark Nicholson, Ganesh Pai, Michael Wilkinson

The aviation literature gives relatively little guidance to practitioners about the specifics of architecting systems for safety, particularly the impact of architecture on allocating safety requirements, or the relative…