MorphoNAS: Embryogenic Neural Architecture Search Through Morphogen-Guided Development
While biological neural networks develop from compact genomes using relatively simple rules, modern artificial neural architecture search methods mostly involve explicit and routine manual work. In this paper, we introduce MorphoNAS (Morphogenetic Neural Architecture Search), a system able to deterministically grow neural networks through morphogenetic self-organization inspired by the Free Energy Principle, reaction-diffusion systems, and gene regulatory networks. In MorphoNAS, simple genomes encode just morphogens dynamics and threshold-based rules of cellular development. Nevertheless, this leads to self-organization of a single progenitor cell into complex neural networks, while the entire process is built on local chemical interactions. Our evolutionary experiments focused on two different domains: structural targeting, in which MorphoNAS system was able to find fully successful genomes able to generate predefined random graph configurations (8-31 nodes); and functional performance on the CartPole control task achieving low complexity 6-7 neuron solutions when target network size minimization evolutionary pressure was applied. The evolutionary process successfully balanced between quality of of the final solutions and neural architecture search effectiveness. Overall, our findings suggest that the proposed MorphoNAS method is able to grow complex specific neural architectures, using simple developmental rules, which suggests a feasible biological route to adaptive and efficient neural architecture search.
Code (0)
등록된 구현이 없습니다.
Tasks
Neural Architecture SearchSimilar Papers 제목 키워드 기반
Cryopreservation of sugarcane embryogenic callus using a simplified freezing process
A simplified freezing process was developed and successfully applied to embryogenic calluses of three sugarcane commercial hybrids (Saccharum sp. cv. CP 5243, C 91-301 and C 1051-73). To obtain optimal survival, the call…
Activity-Dependent Plasticity in Morphogenetically-Grown Recurrent Networks
Developmental approaches to neural architecture search grow functional networks from compact genomes through self-organisation, but the resulting networks operate with fixed post-growth weights. We characterise Hebbian a…
Neural Architecture SearchOrgan-specific Branching Morphogenesis
A common developmental process, called branching morphogenesis, generates the epithelial trees in a variety of organs, including the lungs, kidneys, and glands. How branching morphogenesis can create epithelial architect…
PositionEffect of cryopreservation on the structural and functional integrity of cell membranes of sugarcane (Saccharum sp.) embryogenic calluses
In this paper, we investigated if the differences consistently noted in survival and plantlet production between cryopreserved and non-cryopreserved, control sugarcane embryogenic calluses were related to modifications i…
Mechanics of Morphogenesis in Neural Development: in vivo, in vitro, and in silico
Morphogenesis in the central nervous system has received intensive attention as elucidating fundamental mechanisms of morphogenesis will shed light on the physiology and pathophysiology of the developing central nervous …