paper-with-me

홈 › Papers

Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players

2026-05-27 · Fangfu Liu, Kai He, Tianchang Shen, Tianshi Cao, Sanja Fidler, Yueqi Duan, Jun Gao, Igor Gilitschenski, Zian Wang, Xuanchi Ren arxiv

World models for interactive video generation have largely focused on single-agent settings, where future observations are generated from a single control signal. However, many generated environments require multi-agent interaction: multiple players, robots, or embodied agents act simultaneously within a shared space. Scaling world models to such settings requires a principled multi-agent design: agents should remain independently controllable, permutation-symmetric, and support efficient inference while maintaining consistency across time and perspectives. In this paper, we present our generative multi-agent world model for interactive simulation. It introduces Simplex Rotary Agent Encoding, a parameter-free extension of 3D RoPE that represents agents as vertices of a regular simplex in rotary angle space. This gives each agent a distinct phase while making all agents permutation-equivalent, enabling scalable agent identity without learned per-slot identities or a fixed agent ordering. To avoid dense all-to-all attention across agents, we further propose Sparse Hub Attention, where learnable hub tokens mediate token interaction across agents, reducing cross-agent attention cost from quadratic to linear in the number of agents. For real-time rollout, we distill a full-context diffusion teacher into a causal student that generates temporal blocks sequentially with KV caching, enabling action-responsive generation at 24 FPS. Experiments in multiplayer virtual environments show that our model improves video fidelity, action controllability, and inter-agent consistency over slot-based and dense-attention baselines, while generalizing from two to four players without additional training.

📄 PDF Abstract BibTeX arXiv:2605.28816

Code (0)

등록된 구현이 없습니다.

Tasks

Video Generation

Similar Papers 제목 키워드 기반

GAMMA: A General Agent Motion Model for Autonomous Driving

2019-06-04 · Yuanfu Luo, Panpan Cai, Yiyuan Lee, David Hsu

This paper presents GAMMA, a general motion prediction model that enables large-scale real-time simulation and planning for autonomous driving. GAMMA models heterogeneous, interactive traffic agents. They operate under d…

Autonomous DrivingCollision AvoidanceComputational Efficiencymotion prediction+1

Active World Model Learning in Agent-rich Environments with Progress Curiosity

2020-01-01 · ICML 2020 1 · Kuno Kim, Megumi Sano, Julian De Freitas, Nick Haber 외

World models are a family of predictive models that solve self-supervised problems on how the world evolves. Humans learn world models by curiously exploring their environment, in the process acquiring compact abstractio…

Active World Model Learning with Progress Curiosity

2020-07-15 · Kuno Kim, Megumi Sano, Julian De Freitas, Nick Haber 외

World models are self-supervised predictive models of how the world evolves. Humans learn world models by curiously exploring their environment, in the process acquiring compact abstractions of high bandwidth sensory inp…

model

Learning to Cooperate with Humans using Generative Agents

2024-11-21 · Yancheng Liang, Daphne Chen, Abhishek Gupta, Simon S. Du 외

Training agents that can coordinate zero-shot with humans is a key mission in multi-agent reinforcement learning (MARL). Current algorithms focus on training simulated human partner policies which are then used to train …

Multi-agent Reinforcement Learning

Piecewise-Stationary Multi-Objective Multi-Armed Bandit with Application to Joint Communications and Sensing

2023-02-10 · Amir Rezaei Balef, Setareh Maghsudi

We study a multi-objective multi-armed bandit problem in a dynamic environment. The problem portrays a decision-maker that sequentially selects an arm from a given set. If selected, each action produces a reward vector, …

Change DetectionMulti-Armed BanditsMulti-Objective Reinforcement Learning