Drawing Inspiration from Biological Dendrites to Empower Artificial Neural Networks
This article highlights specific features of biological neurons and their dendritic trees, whose adoption may help advance artificial neural networks used in various machine learning applications. Advancements could take the form of increased computational capabilities and/or reduced power consumption. Proposed features include dendritic anatomy, dendritic nonlinearities, and compartmentalized plasticity rules, all of which shape learning and information processing in biological networks. We discuss the computational benefits provided by these features in biological neurons and suggest ways to adopt them in artificial neurons in order to exploit the respective benefits in machine learning.
Code (0)
등록된 구현이 없습니다.
Tasks
AnatomyBIG-bench Machine LearningSimilar Papers 제목 키워드 기반
A versatile circuit for emulating active biological dendrites applied to sound localisation and neuron imitation
Sophisticated machine learning struggles to transition onto battery-operated devices due to the high-power consumption of neural networks. Researchers have turned to neuromorphic engineering, inspired by biological neura…
Mapping Biological Neuron Dynamics into an Interpretable Two-layer Artificial Neural Network
Dendrites are crucial structures for computation of an individual neuron. It has been shown that the dynamics of a biological neuron with dendrites can be approximated by artificial neural networks (ANN) with deep struct…
image-classificationImage ClassificationPerforated Backpropagation: A Neuroscience Inspired Extension to Artificial Neural Networks
The neurons of artificial neural networks were originally invented when much less was known about biological neurons than is known today. Our work explores a modification to the core neuron unit to make it more parallel …
Drug DiscoveryLanguage ModelingModel CompressionStock Trend PredictionBiologically-inspired neuronal adaptation improves learning in neural networks
Since humans still outperform artificial neural networks on many tasks, drawing inspiration from the brain may help to improve current machine learning algorithms. Contrastive Hebbian Learning (CHL) and Equilibrium Propa…
NSPDI-SNN: An efficient lightweight SNN based on nonlinear synaptic pruning and dendritic integration
Spiking neural networks (SNNs) are artificial neural networks based on simulated biological neurons and have attracted much attention in recent artificial intelligence technology studies. The dendrites in biological neur…
Reinforcement LearningSpeech Recognition