Predator-prey survival pressure is sufficient to evolve swarming behaviors
The comprehension of how local interactions arise in global collective behavior is of utmost importance in both biological and physical research. Traditional agent-based models often rely on static rules that fail to capture the dynamic strategies of the biological world. Reinforcement learning has been proposed as a solution, but most previous methods adopt handcrafted reward functions that implicitly or explicitly encourage the emergence of swarming behaviors. In this study, we propose a minimal predator-prey coevolution framework based on mixed cooperative-competitive multiagent reinforcement learning, and adopt a reward function that is solely based on the fundamental survival pressure, that is, prey receive a reward of $-1$ if caught by predators while predators receive a reward of $+1$. Surprisingly, our analysis of this approach reveals an unexpectedly rich diversity of emergent behaviors for both prey and predators, including flocking and swirling behaviors for prey, as well as dispersion tactics, confusion, and marginal predation phenomena for predators. Overall, our study provides novel insights into the collective behavior of organisms and highlights the potential applications in swarm robotics.
Code (0)
등록된 구현이 없습니다.
Tasks
Diversityreinforcement-learningReinforcement LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Predator confusion is sufficient to evolve swarming behavior
Swarming behaviors in animals have been extensively studied due to their implications for the evolution of cooperation, social cognition, and predator-prey dynamics. An important goal of these studies is discerning which…
Evolution of Fear and Social Rewards in Prey-Predator Relationship
Fear is a critical brain function that enables us to learn to avoid danger via reinforcement learning (RL). While many researchers have argued that fear has evolved to escape predators, how varying predatory pressures ha…
Reinforcement LearningEvolution of swarming behavior is shaped by how predators attack
Animal grouping behaviors have been widely studied due to their implications for understanding social intelligence, collective cognition, and potential applications in engineering, artificial intelligence, and robotics. …
The balance between contamination and predation determine species existence in prey-predator dynamics with contaminated and uncontaminated prey
In freshwater ecosystems, aquatic insects that ontogenetically shift their habitat from aquatic to terrestrial play vital roles as prey subsidies that move nutrients and energy from aquatic to terrestrial food webs. As a…
Coevolutionary patterns caused by prey selection
Many theoretical models have been formulated to better understand the coevolutionary patterns that emerge from antagonistic interactions. These models usually assume that the attacks by the exploiters are random, so the …