A Sustainable Ecosystem through Emergent Cooperation in Multi-Agent Reinforcement Learning
This paper considers sustainable and cooperative behavior in multi-agent systems. In the proposed predator-prey simulation, multiple selfish predators can learn to act sustainably by maintaining a herd of reproducing prey and further hunt cooperatively for long term benefit. Since the predators face starvation pressure, the scenario can also turn in a tragedy of the commons if selfish individuals decide to greedily hunt down the prey population before their conspecifics do, ultimately leading to extinction of prey and predators. This paper uses Multi-Agent Reinforcement Learning to overcome a collapse of the simulated ecosystem, analyzes the impact factors over multiple dimensions and proposes suitable metrics. We show that up to three predators are able to learn sustainable behavior in form of collective herding under starvation pressure. Complex cooperation in form of group hunting emerges between the predators as their speed is handicapped and the prey is given more degrees of freedom to escape. The implementation of environment and reinforcement learning pipeline is available online.
Code (1)
Tasks
Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Modeling Cost-Associated Cooperation: A Dilemma of Species Interaction Unveiling New Aspects of Fear Effect
With limited resources, competition is widespread, yet cooperation persists across taxa, from microorganisms to large mammals. Recent observations reveal contingent factors often drive cooperative interactions, with the …
Emergent Cooperation in Quantum Multi-Agent Reinforcement Learning Using Communication
Emergent cooperation in classical Multi-Agent Reinforcement Learning has gained significant attention, particularly in the context of Sequential Social Dilemmas (SSDs). While classical reinforcement learning approaches h…
Multi-agent Reinforcement LearningClosed ecosystems extract energy through self-organized nutrient cycles
Our planet is roughly closed to matter, but open to energy input from the sun. However, to harness this energy, organisms must transform matter from one chemical (redox) state to another. For example, photosynthetic orga…
Emergent competition shapes the ecological properties of multi-trophic ecosystems
Ecosystems are commonly organized into trophic levels -- organisms that occupy the same level in a food chain (e.g., plants, herbivores, carnivores). A fundamental question in theoretical ecology is how the interplay bet…
DiversityComputational Foundations for Strategic Coopetition: Formalizing Sequential Interaction and Reciprocity
Strategic coopetition in multi-stakeholder systems requires understanding how cooperation persists through time without binding contracts. This technical report extends computational foundations for strategic coopetition…