paper-with-me

Papers

Dataflow Aware Mapping of Convolutional Neural Networks Onto Many-Core Platforms With Network-on-Chip Interconnect

2020-06-18 · Andreas Bytyn, René Ahlsdorf, Rainer Leupers, Gerd Ascheid

Machine intelligence, especially using convolutional neural networks (CNNs), has become a large area of research over the past years. Increasingly sophisticated hardware accelerators are proposed that exploit e.g. the sparsity in computations and make use of reduced precision arithmetic to scale down the energy consumption. However, future platforms require more than just energy efficiency: Scalability is becoming an increasingly important factor. The required effort for physical implementation grows with the size of the accelerator making it more difficult to meet target constraints. Using many-core platforms consisting of several homogeneous cores can alleviate the aforementioned limitations with regard to physical implementation at the expense of an increased dataflow mapping effort. While the dataflow in CNNs is deterministic and can therefore be optimized offline, the problem of finding a suitable scheme that minimizes both runtime and off-chip memory accesses is a challenging task which becomes even more complex if an interconnect system is involved. This work presents an automated mapping strategy starting at the single-core level with different optimization targets for minimal runtime and minimal off-chip memory accesses. The strategy is then extended towards a suitable many-core mapping scheme and evaluated using a scalable system-level simulation with a network-on-chip interconnect. Design space exploration is performed by mapping the well-known CNNs AlexNet and VGG-16 to platforms of different core counts and computational power per core in order to investigate the trade-offs. Our mapping strategy and system setup is scaled starting from the single core level up to 128 cores, thereby showing the limits of the selected approach.

📄 PDF Abstract BibTeX arXiv:2006.12274

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Learned Cost Model for Placement on Reconfigurable Dataflow Hardware

2025-10-21 · Etash Guha, Tianxiao Jiang, Andrew Deng, Jian Zhang 외 arxiv

Mapping a dataflow-graph of an ML model onto a reconfigurable system is difficult, as different mappings have different throughputs and consume resource constraints differently. To solve this, a model to evaluate the thr…

fpgaHART: A toolflow for throughput-oriented acceleration of 3D CNNs for HAR onto FPGAs

2023-05-31 · Petros Toupas, Christos-Savvas Bouganis, Dimitrios Tzovaras

Surveillance systems, autonomous vehicles, human monitoring systems, and video retrieval are just few of the many applications in which 3D Convolutional Neural Networks are exploited. However, their extensive use is rest…

Action RecognitionAutonomous VehiclesRetrievalTemporal Action Localization+1

Mixed-TD: Efficient Neural Network Accelerator with Layer-Specific Tensor Decomposition

2023-06-08 · Zhewen Yu, Christos-Savvas Bouganis

Neural Network designs are quite diverse, from VGG-style to ResNet-style, and from Convolutional Neural Networks to Transformers. Towards the design of efficient accelerators, many works have adopted a dataflow-based, in…

Efficient Neural NetworkQuantizationTensor Decomposition

HASS: Hardware-Aware Sparsity Search for Dataflow DNN Accelerator

2024-06-05 · Zhewen Yu, Sudarshan Sreeram, Krish Agrawal, Junyi Wu 외

Deep Neural Networks (DNNs) excel in learning hierarchical representations from raw data, such as images, audio, and text. To compute these DNN models with high performance and energy efficiency, these models are usually…

HybridFlow: A Flexible and Efficient RLHF Framework

2024-09-28 · Guangming Sheng, Chi Zhang, Zilingfeng Ye, Xibin Wu 외

Reinforcement Learning from Human Feedback (RLHF) is widely used in Large Language Model (LLM) alignment. Traditional RL can be modeled as a dataflow, where each node represents computation of a neural network (NN) and e…

Large Language Model