paper-with-me

홈 › Papers

Accelerating Generative Neural Networks on Unmodified Deep Learning Processors -- A Software Approach

2019-07-03 · Dawen Xu, Ying Wang, Kaijie Tu, Cheng Liu, Bingsheng He, Lei Zhang

Generative neural network is a new category of neural networks and it has been widely utilized in applications such as content generation, unsupervised learning, segmentation and pose estimation. It typically involves massive computing-intensive deconvolution operations that cannot be fitted to conventional neural network processors directly. However, prior works mainly investigated specialized hardware architectures through intensive hardware modifications to the existing deep learning processors to accelerate deconvolution together with the convolution. In contrast, this work proposes a novel deconvolution implementation with a software approach and enables fast and efficient deconvolution execution on the legacy deep learning processors. Our proposed method reorganizes the computation of deconvolution and allows the deep learning processors to treat it as the standard convolution by splitting the original deconvolution filters into multiple small filters. Compared to prior acceleration schemes, the implemented acceleration scheme achieves 2.41x - 4.34x performance speedup and reduces the energy consumption by 27.7% - 54.5% on a set of realistic benchmarks. In addition, we also applied the deconvolution computing approach to the off-the-shelf commodity deep learning processors. The performance of deconvolution also exhibits significant performance speedup over prior deconvolution implementations.

📄 PDF Abstract BibTeX arXiv:1907.01773

Code (2)

warmthless/split-deconvolution 공식 구현 tf
wangying-ict/FCN tf

Tasks

Deep LearningPose Estimation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

GFormer: Accelerating Large Language Models with Optimized Transformers on Gaudi Processors

2024-12-19 · Chengming Zhang, Xinheng Ding, Baixi Sun, Xiaodong Yu 외

Heterogeneous hardware like Gaudi processor has been developed to enhance computations, especially matrix operations for Transformer-based large language models (LLMs) for generative AI tasks. However, our analysis indic…

MME

Accelerating HPC codes on Intel(R) Omni-Path Architecture networks: From particle physics to Machine Learning

2017-11-13 · Peter Boyle, Michael Chuvelev, Guido Cossu, Christopher Kelly 외

We discuss practical methods to ensure near wirespeed performance from clusters with either one or two Intel(R) Omni-Path host fabric interfaces (HFI) per node, and Intel(R) Xeon Phi(TM) 72xx (Knight's Landing) processor…

BIG-bench Machine Learning

BENCHIP: Benchmarking Intelligence Processors

2017-10-23 · Jinhua Tao, Zidong Du, Qi Guo, Huiying Lan 외

The increasing attention on deep learning has tremendously spurred the design of intelligence processing hardware. The variety of emerging intelligence processors requires standard benchmarks for fair comparison and syst…

BenchmarkingDiversity

Extreme Software Defined Radio -- GHz in Real Time

2020-01-10

Software defined radio is a widely accepted paradigm for design of reconfigurable modems. The continuing march of Moore's law makes real-time signal processing on general purpose processors feasible for a large set of wa…

GPU

swCaffe: a Parallel Framework for Accelerating Deep Learning Applications on Sunway TaihuLight

2019-03-16 · Jiarui Fang, Liandeng Li, Haohuan Fu, Jinlei Jiang 외

This paper reports our efforts on swCaffe, a highly efficient parallel framework for accelerating deep neural networks (DNNs) training on Sunway TaihuLight, the current fastest supercomputer in the world that adopts a un…

CPUGPU