Agent-Centric Representations for Multi-Agent Reinforcement Learning

2021-04-19 · Wenling Shang, Lasse Espeholt, Anton Raichuk, Tim Salimans

Object-centric representations have recently enabled significant progress in tackling relational reasoning tasks. By building a strong object-centric inductive bias into neural architectures, recent efforts have improved generalization and data efficiency of machine learning algorithms for these problems. One problem class involving relational reasoning that still remains under-explored is multi-agent reinforcement learning (MARL). Here we investigate whether object-centric representations are also beneficial in the fully cooperative MARL setting. Specifically, we study two ways of incorporating an agent-centric inductive bias into our RL algorithm: 1. Introducing an agent-centric attention module with explicit connections across agents 2. Adding an agent-centric unsupervised predictive objective (i.e. not using action labels), to be used as an auxiliary loss for MARL, or as the basis of a pre-training step. We evaluate these approaches on the Google Research Football environment as well as DeepMind Lab 2D. Empirically, agent-centric representation learning leads to the emergence of more complex cooperation strategies between agents as well as enhanced sample efficiency and generalization.

📄 PDF Abstract BibTeX arXiv:2104.09402

Code (0)

등록된 구현이 없습니다.

Tasks

Inductive BiasMulti-agent Reinforcement LearningObjectreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Relational Reasoning Representation Learning

StepPO: Step-Aligned Policy Optimization for Agentic Reinforcement Learning

2026-04-20 · Daoyu Wang, Qingchuan Li, Mingyue Cheng, Jie Ouyang 외 arxiv

Agentic reinforcement learning (RL) is emerging as a critical post-training paradigm for improving LLM agent capabilities. Existing RL algorithms for LLMs largely follow the token-centric paradigm as in RLHF and RLVR, wh…

Reinforcement Learning

Interpretable end-to-end Neurosymbolic Reinforcement Learning agents

2024-10-18 · Nils Grandien, Quentin Delfosse, Kristian Kersting

Deep reinforcement learning (RL) agents rely on shortcut learning, preventing them from generalizing to slightly different environments. To address this problem, symbolic method, that use object-centric states, have been…

Atari Games Deep Reinforcement Learning Object reinforcement-learning+2

Deep Reinforcement Learning via Object-Centric Attention

2025-04-03 · Jannis Blüml, Cedric Derstroff, Bjarne Gregori, Elisabeth Dillies 외

Deep reinforcement learning agents, trained on raw pixel inputs, often fail to generalize beyond their training environments, relying on spurious correlations and irrelevant background details. To address this issue, obj…

Deep Reinforcement Learning Inductive Bias Object reinforcement-learning+1

Feature-Attending Recurrent Modules for Generalization in Reinforcement Learning

2021-12-15 · Wilka Carvalho, Andrew Lampinen, Kyriacos Nikiforou, Felix Hill 외

Many important tasks are defined in terms of object. To generalize across these tasks, a reinforcement learning (RL) agent needs to exploit the structure that the objects induce. Prior work has either hard-coded object-c…

Object reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Self-supervised Visual Reinforcement Learning with Object-centric Representations

2020-11-29 · ICLR 2021 1 · Andrii Zadaianchuk, Maximilian Seitzer, Georg Martius

Autonomous agents need large repertoires of skills to act reasonably on new tasks that they have not seen before. However, acquiring these skills using only a stream of high-dimensional, unstructured, and unlabeled obser…