Gradient Diffusion: Enhancing Existing Neural Models with Homeostatic Control and Tuning
Realistic brain modeling requires precise estimation of numerous unobserved parameters, a task hindered by complex nonlinearities and the inaccessibility of the brain's full dynamical state. Current multicompartmental-model simulations predominantly rely on gradient-free optimization methods, which suffer from the ``curse of dimensionality'' and are incompatible with online tuning crucial for emulating biological homeostasis. Gradient-based methods offer superior scalability and facilitate online adaptation but are currently inaccessible within existing brain simulators due to the significant resource investment and incompatibility with established simulators. This work introduces a novel methodology for computing parameter gradients for any existing model-and-simulator combination, enabling both offline and online tuning, including the implementation of homeostatic-control mechanisms. Our approach seamlessly integrates traditional simulations with gradient-based optimization, facilitating scalable, robust and adaptive brain simulation without the need for developing new simulators.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Plug-and-Play Homeostatic Spark: Zero-Cost Acceleration for SNN Training Across Paradigms
Spiking neural networks offer event driven computation, sparse activation, and hardware efficiency, yet training often converges slowly and lacks stability. We present Adaptive Homeostatic Spiking Activity Regulation (AH…
A biological gradient descent for prediction through a combination of STDP and homeostatic plasticity
Identifying, formalizing and combining biological mechanisms which implement known brain functions, such as prediction, is a main aspect of current research in theoretical neuroscience. In this letter, the mechanisms of …
Enhancing High-Resolution 3D Generation through Pixel-wise Gradient Clipping
High-resolution 3D object generation remains a challenging task primarily due to the limited availability of comprehensive annotated training data. Recent advancements have aimed to overcome this constraint by harnessing…
3D GenerationTransfer LearningAgnostic Physics-Driven Deep Learning
This work establishes that a physical system can perform statistical learning without gradient computations, via an Agnostic Equilibrium Propagation (Aeqprop) procedure that combines energy minimization, homeostatic cont…
Deep LearningInstability and fingering of interfaces in growing tissue
Interfaces in tissues are ubiquitous, both between tissue and environment as well as between populations of different cell types. The propagation of an interface can be driven mechanically. % e.g. by a difference in the …
Friction