Pre-RTL DNN Hardware Evaluator With Fused Layer Support
With the popularity of the deep neural network (DNN), hardware accelerators are demanded for real time execution. However, lengthy design process and fast evolving DNN models make hardware evaluation hard to meet the time to market need. This paper proposes a pre-RTL DNN hardware evaluator that supports conventional layer-by-layer processing as well as the fused layer processing for low external bandwidth requirement. The evaluator supports two state-of-the-art accelerator architectures and finds the best hardware and layer fusion group The experimental results show the layer fusion scheme can achieve 55.6% memory bandwidth reduction, 36.7% latency improvement and 49.2% energy reduction compared with layer-by-layer operation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
HYDRA: Hybrid Data Multiplexing and Run-time Layer Configurable DNN Accelerator
Deep neural networks (DNNs) offer plenty of challenges in executing efficient computation at edge nodes, primarily due to the huge hardware resource demands. The article proposes HYDRA, hybrid data multiplexing, and runt…
LLMEasyQuant: Scalable Quantization for Parallel and Distributed LLM Inference
As large language models (LLMs) grow in size and deployment scale, quantization has become an essential technique for reducing memory footprint and improving inference efficiency. However, existing quantization toolkits …
GPUQuantizationOne Transform To Compute Them All: Efficient Fusion-Based Full-Reference Video Quality Assessment
The Visual Multimethod Assessment Fusion (VMAF) algorithm has recently emerged as a state-of-the-art approach to video quality prediction, that now pervades the streaming and social media industry. However, since VMAF re…
AllComputational EfficiencyVideo CompressionVideo Quality AssessmentAn FPGA-Based Accelerator Enabling Efficient Support for CNNs with Arbitrary Kernel Sizes
Convolutional neural networks (CNNs) with large kernels, drawing inspiration from the key operations of vision transformers (ViTs), have demonstrated impressive performance in various vision-based applications. To addres…
Computational EfficiencyOn Efficient Scaling of GNNs via IO-Aware Layers Implementations
Graph Neural Networks (GNNs) are bottlenecked by sparse, irregular memory access. Popular frameworks such as DGL and PyTorch Geometric support general message passing, but complex layers often materialize edge-wise inter…