paper-with-me

Papers

Enhancing learning in spiking neural networks through neuronal heterogeneity and neuromodulatory signaling

2024-07-05 · Alejandro Rodriguez-Garcia, Jie Mei, Srikanth Ramaswamy

Recent progress in artificial intelligence (AI) has been driven by insights from neuroscience, particularly with the development of artificial neural networks (ANNs). This has significantly enhanced the replication of complex cognitive tasks such as vision and natural language processing. Despite these advances, ANNs struggle with continual learning, adaptable knowledge transfer, robustness, and resource efficiency - capabilities that biological systems handle seamlessly. Specifically, ANNs often overlook the functional and morphological diversity of the brain, hindering their computational capabilities. Furthermore, incorporating cell-type specific neuromodulatory effects into ANNs with neuronal heterogeneity could enable learning at two spatial scales: spiking behavior at the neuronal level, and synaptic plasticity at the circuit level, thereby potentially enhancing their learning abilities. In this article, we summarize recent bio-inspired models, learning rules and architectures and propose a biologically-informed framework for enhancing ANNs. Our proposed dual-framework approach highlights the potential of spiking neural networks (SNNs) for emulating diverse spiking behaviors and dendritic compartments to simulate morphological and functional diversity of neuronal computations. Finally, we outline how the proposed approach integrates brain-inspired compartmental models and task-driven SNNs, balances bioinspiration and complexity, and provides scalable solutions for pressing AI challenges, such as continual learning, adaptability, robustness, and resource-efficiency.

📄 PDF Abstract BibTeX arXiv:2407.04525

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningDiversityTransfer Learning

Similar Papers 제목 키워드 기반

Dive into the Power of Neuronal Heterogeneity

2023-05-19 · Guobin Shen, Dongcheng Zhao, Yiting Dong, Yang Li 외

The biological neural network is a vast and diverse structure with high neural heterogeneity. Conventional Artificial Neural Networks (ANNs) primarily focus on modifying the weights of connections through training while …

continuous-controlContinuous Control

GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networks

2022-10-25 · Xingting Yao, Fanrong Li, Zitao Mo, Jian Cheng

Spiking Neural Networks (SNNs) have been studied over decades to incorporate their biological plausibility and leverage their promising energy efficiency. Throughout existing SNNs, the leaky integrate-and-fire (LIF) mode…

Heterogeneous Neuronal and Synaptic Dynamics for Spike-Efficient Unsupervised Learning: Theory and Design Principles

2023-02-22 · Biswadeep Chakraborty, Saibal Mukhopadhyay

This paper shows that the heterogeneity in neuronal and synaptic dynamics reduces the spiking activity of a Recurrent Spiking Neural Network (RSNN) while improving prediction performance, enabling spike-efficient (unsupe…

Bayesian OptimizationDiversityLearning TheoryPrediction+3

The role of inhibitory neuronal variability in modulating phase diversity between coupled networks

2024-11-29 · Katiele V. P. Brito, Joana M. G. L. Silva, Claudio R. Mirasso, Fernanda S. Matias

Neuronal heterogeneity, characterized by the presence of a multitude of spiking neuronal patterns, is a widespread phenomenon throughout the nervous system. In particular, the brain exhibits strong variability among inhi…

Diversity

Introducing Astrocytes on a Neuromorphic Processor: Synchronization, Local Plasticity and Edge of Chaos

2019-07-02 · Guangzhi Tang, Ioannis E. Polykretis, Vladimir A. Ivanov, Arpit Shah 외

While there is still a lot to learn about astrocytes and their neuromodulatory role in the spatial and temporal integration of neuronal activity, their introduction to neuromorphic hardware is timely, facilitating their …