paper-with-me

홈 › Papers

The computational and learning benefits of Daleian neural networks

2022-10-12 · Adam Haber, Elad Schneidman

Dale's principle implies that biological neural networks are composed of neurons that are either excitatory or inhibitory. While the number of possible architectures of such Daleian networks is exponentially smaller than non-Daleian ones, the computational and functional implications of using Daleian networks by the brain are mostly unknown. Here, we use models of recurrent spiking neural networks and rate-based networks to show, surprisingly, that despite the structural limitations on Daleian networks, they can approximate the computation performed by non-Daleian networks to a very high degree of accuracy. Moreover, we find that Daleian networks are more functionally robust to synaptic noise. We then show that unlike non-Daleian networks, Daleian ones can learn efficiently by tuning single neuron features, nearly as well as learning by tuning individual synaptic weights - suggesting a simpler and more biologically plausible learning mechanism. We thus suggest that in addition to architectural simplicity, Dale's principle confers computational and learning benefits for biological networks, and offers new directions for constructing and training biologically-inspired artificial neural networks

📄 PDF Abstract BibTeX arXiv:2210.05961

Code (1)

adamhaber/daleian_networks 공식 구현 jax

Similar Papers 제목 키워드 기반

Emerging trends in machine learning for computational fluid dynamics

2022-11-28 · Ricardo Vinuesa, Steve Brunton

The renewed interest from the scientific community in machine learning (ML) is opening many new areas of research. Here we focus on how novel trends in ML are providing opportunities to improve the field of computational…

Improved optimization strategies for deep Multi-Task Networks

2021-09-21 · Lucas Pascal, Pietro Michiardi, Xavier Bost, Benoit Huet 외

In Multi-Task Learning (MTL), it is a common practice to train multi-task networks by optimizing an objective function, which is a weighted average of the task-specific objective functions. Although the computational adv…

Computational EfficiencyMulti-Task Learning

Drawing Inspiration from Biological Dendrites to Empower Artificial Neural Networks

2021-06-14 · Spyridon Chavlis, Panayiota Poirazi

This article highlights specific features of biological neurons and their dendritic trees, whose adoption may help advance artificial neural networks used in various machine learning applications. Advancements could take…

AnatomyBIG-bench Machine Learning

Computational Social Choice and Computational Complexity: BFFs?

2017-10-30 · Lane A. Hemaspaandra

We discuss the connection between computational social choice (comsoc) and computational complexity. We stress the work so far on, and urge continued focus on, two less-recognized aspects of this connection. Firstly, thi…

General Classification

Computational Benefits of Intermediate Rewards for Goal-Reaching Policy Learning

2021-07-08 · Yuexiang Zhai, Christina Baek, Zhengyuan Zhou, Jiantao Jiao 외

Many goal-reaching reinforcement learning (RL) tasks have empirically verified that rewarding the agent on subgoals improves convergence speed and practical performance. We attempt to provide a theoretical framework to q…

Hierarchical Reinforcement LearningQ-LearningReinforcement Learning (RL)