Design Principles for Lifelong Learning AI Accelerators
Lifelong learning - an agent's ability to learn throughout its lifetime - is a hallmark of biological learning systems and a central challenge for artificial intelligence (AI). The development of lifelong learning algorithms could lead to a range of novel AI applications, but this will also require the development of appropriate hardware accelerators, particularly if the models are to be deployed on edge platforms, which have strict size, weight, and power constraints. Here, we explore the design of lifelong learning AI accelerators that are intended for deployment in untethered environments. We identify key desirable capabilities for lifelong learning accelerators and highlight metrics to evaluate such accelerators. We then discuss current edge AI accelerators and explore the future design of lifelong learning accelerators, considering the role that different emerging technologies could play.
Code (0)
등록된 구현이 없습니다.
Tasks
Lifelong learningSimilar Papers 제목 키워드 기반
Hardware Approximate Techniques for Deep Neural Network Accelerators: A Survey
Deep Neural Networks (DNNs) are very popular because of their high performance in various cognitive tasks in Machine Learning (ML). Recent advancements in DNNs have brought beyond human accuracy in many tasks, but at the…
Learning the Superpixel in a Non-iterative and Lifelong Manner
Superpixel is generated by automatically clustering pixels in an image into hundreds of compact partitions, which is widely used to perceive the object contours for its excellent contour adherence. Although some works us…
ClusteringLifelong learningAdaptive Synaptogenesis Implemented on a Nanomagnetic Platform
The human brain functions very differently from artificial neural networks (ANN) and possesses unique features that are absent in ANN. An important one among them is "adaptive synaptogenesis" that modifies synaptic weigh…
Edge-computingHippocampusLifelong learningContext selectivity with dynamic availability enables lifelong continual learning
"You never forget how to ride a bike", -- but how is that possible? The brain is able to learn complex skills, stop the practice for years, learn other skills in between, and still retrieve the original knowledge when ne…
Continual LearningLifelong learningTransfer LearningEfficient Meta Lifelong-Learning with Limited Memory
Current natural language processing models work well on a single task, yet they often fail to continuously learn new tasks without forgetting previous ones as they are re-trained throughout their lifetime, a challenge kn…
Lifelong learningMulti-Task LearningQuestion Answeringtext-classification+1