Optimality theory of stigmergic collective information processing by chemotactic cells
Collective information processing is fundamental in various biological systems, where the cooperation of multiple cells results in complex functions beyond individual capabilities. A distinctive example is collective exploration where chemotactic cells not only sense the gradient of guiding exogeneous cues originating from targets but also generate and modulate endogenous cues to coordinate their collective behaviors. While the optimality of gradient sensing has been studied extensively in the context of single-cell information processing, the optimality of collective information processing that includes both gradient sensing and gradient generation remains underexplored. In this study, we formulate the collective exploration problem as a reinforcement learning (RL) by a population. Based on RL theory, we derive the optimal exploration dynamics of agents and identify their structural correspondence with the Keller-Segel model, the established phenomenological model of collective cellular dynamics. Our theory identifies an optimal coupling relation between gradient sensing and gradient generation and demonstrates that the optimal way to generate a gradient qualitatively differs depending on whether the gradient sensing is logarithmic or linear. The underlying RL structure is leveraged to compare the derived collective dynamics with single-agent searching dynamics, showing that distributed information processing by population enables a fraction of agents to reach the target robustly. Our formulation provides a foundation for understanding the collective information processing mediated by dynamic sensing and modulation of cues.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement Learning (RL)Similar Papers 제목 키워드 기반
From Pheromones to Policies: Reinforcement Learning for Engineered Biological Swarms
Swarm intelligence emerges from decentralised interactions among simple agents, enabling collective problem-solving. This study establishes a theoretical equivalence between pheromone-mediated aggregation in \celeg\ and …
Reinforcement LearningPareto Optimality, Functional Dependence and Collective Agency
This paper approaches the problem of understanding collective agency from a logical and game-theoretical perspective. Instead of collective intentionality, our analysis highlights the role of Pareto optimality. To facili…
Using stigmergy to incorporate the time into artificial neural networks
A current research trend in neurocomputing involves the design of novel artificial neural networks incorporating the concept of time into their operating model. In this paper, a novel architecture that employs stigmergy …
Decorrelation, Diversity, and Emergent Intelligence: The Isomorphism Between Social Insect Colonies and Ensemble Machine Learning
Social insect colonies and ensemble machine learning methods represent two of the most successful examples of decentralized information processing in nature and computation respectively. Here we develop a rigorous mathem…
Bayesian InferenceSecret Key Agreement with Physical Unclonable Functions: An Optimality Summary
We address security and privacy problems for digital devices and biometrics from an information-theoretic optimality perspective, where a secret key is generated for authentication, identification, message encryption/dec…