paper-with-me

Papers

Continual Learning with Neuromorphic Computing: Theories, Methods, and Applications

2024-10-11 · Mishal Fatima Minhas, Rachmad Vidya Wicaksana Putra, Falah Awwad, Osman Hasan, Muhammad Shafique

To adapt to real-world dynamics, intelligent systems need to assimilate new knowledge without catastrophic forgetting, where learning new tasks leads to a degradation in performance on old tasks. To address this, continual learning concept is proposed for enabling autonomous systems to acquire new knowledge and dynamically adapt to changing environments. Specifically, energy-efficient continual learning is needed to ensure the functionality of autonomous systems under tight compute and memory resource budgets (i.e., so-called autonomous embedded systems). Neuromorphic computing, with brain-inspired Spiking Neural Networks (SNNs), offers inherent advantages for enabling low-power/energy continual learning in autonomous embedded systems. In this paper, we comprehensively discuss the foundations and methods for enabling continual learning in neural networks, then analyze the state-of-the-art works considering SNNs. Afterward, comparative analyses of existing methods are conducted while considering crucial design factors, such as network complexity, memory, latency, and power/energy efficiency. We also explore the practical applications that can benefit from SNN-based continual learning and open challenges in real-world scenarios. In this manner, our survey provides valuable insights into the recent advancements of SNN-based continual learning for real-world application use-cases.

📄 PDF Abstract BibTeX arXiv:2410.09218

Code (0)

등록된 구현이 없습니다.

Tasks

Continual Learning

Similar Papers 제목 키워드 기반

SPAIC: A Spike-based Artificial Intelligence Computing Framework

2022-07-26 · Chaofei Hong, Mengwen Yuan, Mengxiao Zhang, Xiao Wang 외

Neuromorphic computing is an emerging research field that aims to develop new intelligent systems by integrating theories and technologies from multi-disciplines such as neuroscience and deep learning. Currently, there h…

Deep Learning

A Survey of Neuromorphic Computing and Neural Networks in Hardware

2017-05-19 · Catherine D. Schuman, Thomas E. Potok, Robert M. Patton, J. Douglas Birdwell 외

Neuromorphic computing has come to refer to a variety of brain-inspired computers, devices, and models that contrast the pervasive von Neumann computer architecture. This biologically inspired approach has created highly…

NeuroBench: A Framework for Benchmarking Neuromorphic Computing Algorithms and Systems

2023-04-10 · Jason Yik, Korneel Van den Berghe, Douwe den Blanken, Younes Bouhadjar 외

Neuromorphic computing shows promise for advancing computing efficiency and capabilities of AI applications using brain-inspired principles. However, the neuromorphic research field currently lacks standardized benchmark…

Benchmarking

Brain-inspired global-local learning incorporated with neuromorphic computing

2020-06-05 · Yujie Wu, Rong Zhao, Jun Zhu, Feng Chen 외

Two main routes of learning methods exist at present including error-driven global learning and neuroscience-oriented local learning. Integrating them into one network may provide complementary learning capabilities for …

Continual LearningFew-Shot LearningMeta-Learning

Hebbian Learning based Orthogonal Projection for Continual Learning of Spiking Neural Networks

2024-02-19 · Mingqing Xiao, Qingyan Meng, Zongpeng Zhang, Di He 외

Neuromorphic computing with spiking neural networks is promising for energy-efficient artificial intelligence (AI) applications. However, different from humans who continually learn different tasks in a lifetime, neural …

Continual Learning