paper-with-me

Papers

Game-TARS: Pretrained Foundation Models for Scalable Generalist Multimodal Game Agents

2025-10-27 · Zihao Wang, Xujing Li, Yining Ye, Junjie Fang, Haoming Wang, Longxiang Liu, Shihao Liang, Junting Lu, Zhiyong Wu, Jiazhan Feng, Wanjun Zhong, Zili Li, Yu Wang, Yu Miao, Bo Zhou, Yuanfan Li, Hao Wang, Zhongkai Zhao, Faming Wu, Zhengxuan Jiang, Weihao Tan, Heyuan Yao, Shi Yan, Xiangyang Li, Yitao Liang, Yujia Qin, Guang Shi arxiv

We present Game-TARS, a generalist game agent trained with a unified, scalable action space anchored to human-aligned native keyboard-mouse inputs. Unlike API- or GUI-based approaches, this paradigm enables large-scale continual pre-training across heterogeneous domains, including OS, web, and simulation games. Game-TARS is pre-trained on over 500B tokens with diverse trajectories and multimodal data. Key techniques include a decaying continual loss to reduce causal confusion and an efficient Sparse-Thinking strategy that balances reasoning depth and inference cost. Experiments show that Game-TARS achieves about 2 times the success rate over the previous sota model on open-world Minecraft tasks, is close to the generality of fresh humans in unseen web 3d games, and outperforms GPT-5, Gemini-2.5-Pro, and Claude-4-Sonnet in FPS benchmarks. Scaling results on training-time and test-time confirm that the unified action space sustains improvements when scaled to cross-game and multimodal data. Our results demonstrate that simple, scalable action representations combined with large-scale pre-training provide a promising path toward generalist agents with broad computer-use abilities.

📄 PDF Abstract BibTeX arXiv:2510.23691

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

NitroGen: An Open Foundation Model for Generalist Gaming Agents

2026-01-04 · Loïc Magne, Anas Awadalla, Guanzhi Wang, Yinzhen Xu 외 arxiv

We introduce NitroGen, a vision-action foundation model for generalist gaming agents that is trained on 40,000 hours of gameplay videos across more than 1,000 games. We incorporate three key ingredients: 1) an internet-s…

Towards Generalist Game Players: An Investigation of Foundation Models in the Game Multiverse

2026-05-11 · Kuan Zhang, Dongchen Liu, Qiyue Zhao, Tianyu Xin 외 arxiv

The real world unfolds along a single set of physics laws, yet human intelligence demonstrates a remarkable capacity to generalize experiences from this singular physical existence into a multiverse of games, each govern…

Reinforcement Learning

BRIGHT: A Collaborative Generalist-Specialist Foundation Model for Breast Pathology

2026-03-03 · Xiaojing Guo, Jiatai Lin, Yumian Jia, Jingqi Huang 외 arxiv

Generalist pathology foundation models (PFMs), pretrained on large-scale multi-organ datasets, have demonstrated remarkable predictive capabilities across diverse clinical applications. However, their proficiency on the …

Towards Evaluating Generalist Agents: An Automated Benchmark in Open World

2023-10-12 · Xinyue Zheng, Haowei Lin, Kaichen He, ZiHao Wang 외

Evaluating generalist agents presents significant challenges due to their wide-ranging abilities and the limitations of current benchmarks in assessing true generalization. We introduce the Minecraft Universe (MCU), a fu…

BenchmarkingDiversityLanguage ModelingLanguage Modelling+2

FTP-1: A Generalist Foundation Tactile Policy Across Tactile Sensors for Contact-Rich Manipulation

2026-06-11 · Chengbo Yuan, Zicheng Zhang, Mingjie Zhou, Wendi Chen 외 arxiv

Despite the success of vision-based generalist robotic policies, existing tactile-based policies remain tied to fixed embodiments and sensor setups. This is because tactile signals are highly heterogeneous across hardwar…