paper-with-me

Papers

Exploration of Activation Fault Reliability in Quantized Systolic Array-Based DNN Accelerators

2024-01-17 · Mahdi Taheri, Natalia Cherezova, Mohammad Saeed Ansari, Maksim Jenihhin, Ali Mahani, Masoud Daneshtalab, Jaan Raik

The stringent requirements for the Deep Neural Networks (DNNs) accelerator's reliability stand along with the need for reducing the computational burden on the hardware platforms, i.e. reducing the energy consumption and execution time as well as increasing the efficiency of DNN accelerators. Moreover, the growing demand for specialized DNN accelerators with tailored requirements, particularly for safety-critical applications, necessitates a comprehensive design space exploration to enable the development of efficient and robust accelerators that meet those requirements. Therefore, the trade-off between hardware performance, i.e. area and delay, and the reliability of the DNN accelerator implementation becomes critical and requires tools for analysis. This paper presents a comprehensive methodology for exploring and enabling a holistic assessment of the trilateral impact of quantization on model accuracy, activation fault reliability, and hardware efficiency. A fully automated framework is introduced that is capable of applying various quantization-aware techniques, fault injection, and hardware implementation, thus enabling the measurement of hardware parameters. Moreover, this paper proposes a novel lightweight protection technique integrated within the framework to ensure the dependable deployment of the final systolic-array-based FPGA implementation. The experiments on established benchmarks demonstrate the analysis flow and the profound implications of quantization on reliability, hardware performance, and network accuracy, particularly concerning the transient faults in the network's activations.

📄 PDF Abstract BibTeX arXiv:2401.09509

Code (0)

등록된 구현이 없습니다.

Tasks

Quantization

Similar Papers 제목 키워드 기반

FORTALESA: Fault-Tolerant Reconfigurable Systolic Array for DNN Inference

2025-03-06 · Natalia Cherezova, Artur Jutman, Maksim Jenihhin

The emergence of Deep Neural Networks (DNNs) in mission- and safety-critical applications brings their reliability to the front. High performance demands of DNNs require the use of specialized hardware accelerators. Syst…

Improving Reliability of Spiking Neural Networks through Fault Aware Threshold Voltage Optimization

2023-01-12 · Ayesha Siddique, Khaza Anuarul Hoque

Spiking neural networks have made breakthroughs in computer vision by lending themselves to neuromorphic hardware. However, the neuromorphic hardware lacks parallelism and hence, limits the throughput and hardware accele…

SAFFIRA: a Framework for Assessing the Reliability of Systolic-Array-Based DNN Accelerators

2024-03-05 · Mahdi Taheri, Masoud Daneshtalab, Jaan Raik, Maksim Jenihhin 외

Systolic array has emerged as a prominent architecture for Deep Neural Network (DNN) hardware accelerators, providing high-throughput and low-latency performance essential for deploying DNNs across diverse applications. …

Monitor Placement for Fault Localization in Deep Neural Network Accelerators

2023-11-28 · Wei-Kai Liu

Systolic arrays are a prominent choice for deep neural network (DNN) accelerators because they offer parallelism and efficient data reuse. Improving the reliability of DNN accelerators is crucial as hardware faults can d…

Fault localization

Algorithmic Strategies for Sustainable Reuse of Neural Network Accelerators with Permanent Faults

2024-12-17 · Youssef A. Ait Alama, Sampada Sakpal, Ke Wang, Razvan Bunescu 외

Hardware failures are a growing challenge for machine learning accelerators, many of which are based on systolic arrays. When a permanent hardware failure occurs in a systolic array, existing solutions include localizing…