RocketPPA: Code-Level Power, Performance, and Area Prediction via LLM and Mixture of Experts
This paper presents RocketPPA, a novel ultra-fast power, performance (delay), and area (PPA) estimator operating directly at the code-level abstraction using HDL code as input. The key technical innovation is its LLM-based regression model, which uniquely integrates a large language model (LLM) with a mixture-of-experts (MoE) architecture composed of multilayer perceptrons (MLPs). The LLM interprets the input HDL code and then utilizes its final hidden-layer representations to predict PPA metrics. Low-rank adaptation (LoRA) is used for parameter-efficient fine-tuning to enable efficient LLM training. Furthermore, the work includes the development of an LLM-based HDL code repair framework to generate a large and synthesizable training dataset. Experimental results on the VerilogEval benchmark demonstrate that RocketPPA achieves significant improvements in the accuracy of PPA estimation compared to previous state-of-the-art methods like Llama3-MetRex-8B. Specifically, at a 10% relative error threshold, RocketPPA enhances the pass rate for area prediction by 13.6%, delay by 9.4%, and power by 14.7%. At a 20% threshold, the improvements are 9.6% for area, 10.8% for delay, and 18.5% for power. Moreover, RocketPPA achieves a speedup of over 20x compared to MetRex and 30x over MasterRTL in processing the test set. The impact of RocketPPA is the potential to substantially accelerate the hardware design process by providing accurate PPA estimations early in the design cycle, thus avoiding the overhead of manual feature engineering and time-consuming synthesis flows.
Code (0)
등록된 구현이 없습니다.
Tasks
Code RepairFeature EngineeringLarge Language ModelMixture-of-Expertsparameter-efficient fine-tuningSimilar Papers 제목 키워드 기반
Two-level Robust State Estimation for Multi-Area Power Systems Under Bounded Uncertainties
This paper introduces a two-level robust approach to estimate the unknown states of a large-scale power system while the measurements and network parameters are subjected to uncertainties. The bounded data uncertainty (B…
State EstimationData-Driven Wide-Area Control Design of Power System Using the Passivity Shortage Framework
A novel wide-area control design is presented to mitigate inter-area power frequency oscillations. A large-scale power system is decomposed into a network of passivity-short subsystems whose nonlinear interconnections ha…
POET: Power-Oriented Evolutionary Tuning for LLM-Based RTL PPA Optimization
Applying large language models (LLMs) to RTL code optimization for improved power, performance, and area (PPA) faces two key challenges: ensuring functional correctness of optimized designs despite LLM hallucination, and…
An Integrated Model for Financial Risk Assessment of Grid-ignited Wildfires
In recent years, the frequency and intensity of grid-ignited wildfires have increased significantly, leading to an elevated level of risk exposure to public safety and financial repercussions for electric utilities threa…
Make Every Move Count: LLM-based High-Quality RTL Code Generation Using MCTS
Existing large language models (LLMs) for register transfer level code generation face challenges like compilation failures and suboptimal power, performance, and area (PPA) efficiency. This is due to the lack of PPA awa…
Code GenerationLanguage ModelingLanguage Modelling