Generalisation to unseen topologies: Towards control of biological neural network activity
Novel imaging and neurostimulation techniques open doors for advancements in closed-loop control of activity in biological neural networks. This would allow for applications in the investigation of activity propagation, and for diagnosis and treatment of pathological behaviour. Due to the partially observable characteristics of activity propagation, through networks in which edges can not be observed, and the dynamic nature of neuronal systems, there is a need for adaptive, generalisable control. In this paper, we introduce an environment that procedurally generates neuronal networks with different topologies to investigate this generalisation problem. Additionally, an existing transformer-based architecture is adjusted to evaluate the generalisation performance of a deep RL agent in the presented partially observable environment. The agent demonstrates the capability to generalise control from a limited number of training networks to unseen test networks.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Complexity of Activity Patterns in a Bio-Inspired Hopfield-Type Network in Different Topologies
Neural network models capable of storing memory have been extensively studied in computer science and computational neuroscience. The Hopfield network is a prototypical example of a model designed for associative, or con…
Emergent Generalization by Representation Learning in Artificial Neural Networks
Dimensionality reduction has proven powerful for identifying neural manifolds, which are low-dimensional structures underlying high-dimensional neural activity. These low-dimensional representations have improved the int…
Dimensionality ReductionRepresentation LearningInterpretable Causal Representation Learning for Biological Data in the Pathway Space
Predicting the impact of genomic and drug perturbations in cellular function is crucial for understanding gene functions and drug effects, ultimately leading to improved therapies. To this end, Causal Representation Lear…
Representation LearningMxGPS: Multiplex Graph Transformers for a Power Grid Foundation Model
Single-task fine-tuning of graph neural networks (GNNs) for power grid problems exhibits a systematic failure mode: models that achieve the lowest in-distribution error degrade the most under topology shift. We term this…
Entity-based Reinforcement Learning for Autonomous Cyber Defence
A significant challenge for autonomous cyber defence is ensuring a defensive agent's ability to generalise across diverse network topologies and configurations. This capability is necessary for agents to remain effective…
Deep Reinforcement Learningreinforcement-learningReinforcement Learning