Improved Learning in Evolution Strategies via Sparser Inter-Agent Network Topologies

2017-11-30 · Dhaval Adjodah, Dan Calacci, Yan Leng, Peter Krafft, Esteban Moro, Alex Pentland

We draw upon a previously largely untapped literature on human collective intelligence as a source of inspiration for improving deep learning. Implicit in many algorithms that attempt to solve Deep Reinforcement Learning (DRL) tasks is the network of processors along which parameter values are shared. So far, existing approaches have implicitly utilized fully-connected networks, in which all processors are connected. However, the scientific literature on human collective intelligence suggests that complete networks may not always be the most effective information network structures for distributed search through complex spaces. Here we show that alternative topologies can improve deep neural network training: we find that sparser networks learn higher rewards faster, leading to learning improvements at lower communication costs.

📄 PDF Abstract BibTeX arXiv:1711.11180

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

The Ant Swarm Neuro-Evolution Procedure for Optimizing Recurrent Networks

2019-09-26 · AbdElRahman A. ElSaid, Alexander G. Ororbia, Travis J. Desell

Hand-crafting effective and efficient structures for recurrent neural networks (RNNs) is a difficult, expensive, and time-consuming process. To address this challenge, we propose a novel neuro-evolution algorithm based o…

Inductive Bias L2 Regularization Time Series Analysis

LangMARL: Natural Language Multi-Agent Reinforcement Learning

2026-04-01 · Huaiyuan Yao, Longchao Da, Xiaoou Liu, Charles Fleming 외 arxiv

Large language model (LLM) agents struggle to autonomously evolve coordination strategies in dynamic environments, largely because coarse global outcomes obscure the causal signals needed for local policy refinement. We …

Multi-agent Reinforcement Learning

Simulation of Language Evolution under Regulated Social Media Platforms: A Synergistic Approach of Large Language Models and Genetic Algorithms

2025-02-26 · Jinyu Cai, Yusei Ishimizu, Mingyue Zhang, Munan Li 외

Social media platforms frequently impose restrictive policies to moderate user content, prompting the emergence of creative evasion language strategies. This paper presents a multi-agent framework based on Large Language…

Ranking Joint Policies in Dynamic Games using Evolutionary Dynamics

2025-02-20 · Natalia Koliou, George Vouros

Game-theoretic solution concepts, such as the Nash equilibrium, have been key to finding stable joint actions in multi-player games. However, it has been shown that the dynamics of agents' interactions, even in simple tw…

Descriptive

Mathematics of multi-agent learning systems at the interface of game theory and artificial intelligence

2024-03-09 · Long Wang, Feng Fu, Xingru Chen

Evolutionary Game Theory (EGT) and Artificial Intelligence (AI) are two fields that, at first glance, might seem distinct, but they have notable connections and intersections. The former focuses on the evolution of behav…

Multi-agent Reinforcement Learning Self-Learning