paper-with-me

홈 › Papers

RL-MUL 2.0: Multiplier Design Optimization with Parallel Deep Reinforcement Learning and Space Reduction

2024-03-31 · Dongsheng Zuo, Jiadong Zhu, Yikang Ouyang, Yuzhe ma

Multiplication is a fundamental operation in many applications, and multipliers are widely adopted in various circuits. However, optimizing multipliers is challenging due to the extensive design space. In this paper, we propose a multiplier design optimization framework based on reinforcement learning. We utilize matrix and tensor representations for the compressor tree of a multiplier, enabling seamless integration of convolutional neural networks as the agent network. The agent optimizes the multiplier structure using a Pareto-driven reward customized to balance area and delay. Furthermore, we enhance the original framework with parallel reinforcement learning and design space pruning techniques and extend its capability to optimize fused multiply-accumulate (MAC) designs. Experiments conducted on different bit widths of multipliers demonstrate that multipliers produced by our approach outperform all baseline designs in terms of area, power, and delay. The performance gain is further validated by comparing the area, power, and delay of processing element arrays using multipliers from our approach and baseline approaches.

📄 PDF Abstract BibTeX arXiv:2404.00639

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learningReinforcement Learning

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

Teal: Learning-Accelerated Optimization of WAN Traffic Engineering

2022-10-25 · Zhiying Xu, Francis Y. Yan, Rachee Singh, Justin T. Chiu 외

The rapid expansion of global cloud wide-area networks (WANs) has posed a challenge for commercial optimization engines to efficiently solve network traffic engineering (TE) problems at scale. Existing acceleration strat…

Graph Neural NetworkMulti-agent Reinforcement LearningReinforcement Learning (RL)

Parallel Direction Method of Multipliers

2014-12-01 · NeurIPS 2014 12 · Huahua Wang, Arindam Banerjee, Zhi-Quan Luo

We consider the problem of minimizing block-separable convex functions subject to linear constraints. While the Alternating Direction Method of Multipliers (ADMM) for two-block linear constraints has been intensively stu…

Towards Design Space Exploration and Optimization of Fast Algorithms for Convolutional Neural Networks (CNNs) on FPGAs

2019-03-05 · Afzal Ahmad, Muhammad Adeel Pasha

Convolutional Neural Networks (CNNs) have gained widespread popularity in the field of computer vision and image processing. Due to huge computational requirements of CNNs, dedicated hardware-based implementations are be…

Constrained Bayesian Optimization Using a Lagrange Multiplier Applied to Power Transistor Design

2023-08-18 · Ping-Ju Chuang, Ali Saadat, Sara Ghazvini, Hal Edwards 외

We propose a novel constrained Bayesian Optimization (BO) algorithm optimizing the design process of Laterally-Diffused Metal-Oxide-Semiconductor (LDMOS) transistors while realizing a target Breakdown Voltage (BV). We co…

Bayesian Optimization

Low Error-Rate Approximate Multiplier Design for DNNs with Hardware-Driven Co-Optimization

2022-10-08 · Yao Lu, Jide Zhang, Su Zheng, Zhen Li 외

In this paper, two approximate 3*3 multipliers are proposed and the synthesis results of the ASAP-7nm process library justify that they can reduce the area by 31.38% and 36.17%, and the power consumption by 36.73% and 35…