paper-with-me

홈 › Papers

Multi-Task Learning for Heterogeneous Prediction from Video Game State with Transfer Learning

2026-07-23 · Jonas Peché, Aliaksei Tsishurou, Alexander Zap, Günter Wallner arxiv

Multi-task learning (MTL) is a promising approach for prediction tasks derived from video game state data, as modern game telemetry provides multiple related supervision signals from the same structured observations. We study whether a shared model trained jointly across tasks in team-based multiplayer games can improve generalization while reducing training and inference cost compared to specialized single-task models. We adapt a multimodal architecture for endpoint prediction to a general multi-task setting that combines rasterized vision inputs, global match context, and per-unit state information through an image encoder and attention-based interaction modeling. Experiments on a large proprietary World of Tanks dataset compare single-task and multi-task training, evaluate weighting strategies for mixed losses and conflicting gradients, and test pre-training/fine-tuning under limited target-data regimes. We also examine within-game transfer across game maps under structured environment shift.

📄 PDF Abstract BibTeX arXiv:2607.21290

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task LearningTransfer Learning

Similar Papers 제목 키워드 기반

GameWAM: A World Action Model for Video Games

2026-08-25 · Yuncheng Guo, Zhanqiu Zhang, Yiwen Guo, Weijia Li hf

Modern video games combine first-person perception, rapid visual changes, persistent world state, and heterogeneous native controls. Existing game agents map visual and task context directly to actions but lack explicit …

Human Action Recognition in Drone Videos using a Few Aerial Training Examples

2019-10-22 · Waqas Sultani, Mubarak Shah

Drones are enabling new forms of human actions surveillance due to their low cost and fast mobility. However, using deep neural networks for automatic aerial action recognition is difficult due to the need for a large nu…

Action ClassificationAction RecognitionTemporal Action Localization

GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game Agents

2026-04-08 · Mingyu Ouyang, Siyuan Hu, Kevin Qinghong Lin, Hwee Tou Ng 외 arxiv

Towards an embodied generalist for real-world interaction, Multimodal Large Language Model (MLLM) agents still suffer from challenging latency, sparse feedback, and irreversible mistakes. Video games offer an ideal testb…

Action Parsing

"How to rate a video game?" - A prediction system for video games based on multimodal information

2018-05-29 · Vishal Batchu, Varshit Battu, Murali Krishna Reddy, Radhika Mamidi

Video games have become an integral part of most people's lives in recent times. This led to an abundance of data related to video games being shared online. However, this comes with issues such as incorrect ratings, rev…

Recommendation Systems

E-Sports Talent Scouting Based on Multimodal Twitch Stream Data

2019-07-02 · Anna Belova, Wen He, Ziyi Zhong

We propose and investigate feasibility of a novel task that consists in finding e-sports talent using multimodal Twitch chat and video stream data. In that, we focus on predicting the ranks of Counter-Strike: Global Offe…