Tetris: Re-architecting Convolutional Neural Network Computation for Machine Learning Accelerators
Inference efficiency is the predominant consideration in designing deep learning accelerators. Previous work mainly focuses on skipping zero values to deal with remarkable ineffectual computation, while zero bits in non-zero values, as another major source of ineffectual computation, is often ignored. The reason lies on the difficulty of extracting essential bits during operating multiply-and-accumulate (MAC) in the processing element. Based on the fact that zero bits occupy as high as 68.9% fraction in the overall weights of modern deep convolutional neural network models, this paper firstly proposes a weight kneading technique that could eliminate ineffectual computation caused by either zero value weights or zero bits in non-zero weights, simultaneously. Besides, a split-and-accumulate (SAC) computing pattern in replacement of conventional MAC, as well as the corresponding hardware accelerator design called Tetris are proposed to support weight kneading at the hardware level. Experimental results prove that Tetris could speed up inference up to 1.50x, and improve power efficiency up to 5.33x compared with the state-of-the-art baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Survey of Near-Data Processing Architectures for Neural Networks
Data-intensive workloads and applications, such as machine learning (ML), are fundamentally limited by traditional computing systems based on the von-Neumann architecture. As data movement operations and energy consumpti…
BIG-bench Machine LearningSurveyThe Game of Tetris in Machine Learning
The game of Tetris is an important benchmark for research in artificial intelligence and machine learning. This paper provides a historical account of the algorithmic developments in Tetris and discusses open challenges.…
BIG-bench Machine Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Bitboard version of Tetris AI
The efficiency of game engines and policy optimization algorithms is crucial for training reinforcement learning (RL) agents in complex sequential decision-making tasks, such as Tetris. Existing Tetris implementations su…
Reinforcement LearningOpenAI GymData-Driven Offline Optimization For Architecting Hardware Accelerators
Industry has gradually moved towards application-specific hardware accelerators in order to attain higher efficiency. While such a paradigm shift is already starting to show promising results, designers need to spend con…
Computer Architecture and SystemsLearn to Play Tetris with Deep Reinforcement Learning
Tetris is one of the most popular video games ever created, perhaps in part because its difficulty makes it addictive. In this course project, we successfully trained a DQN agent in a simplified Tetris environment with …
Deep Reinforcement LearningImitation Learningreinforcement-learningReinforcement Learning+1