paper-with-me

홈 › Papers

Learning to Play Video Games with Intuitive Physics Priors

2024-09-20 · Abhishek Jaiswal, Nisheeth Srivastava

Video game playing is an extremely structured domain where algorithmic decision-making can be tested without adverse real-world consequences. While prevailing methods rely on image inputs to avoid the problem of hand-crafting state space representations, this approach systematically diverges from the way humans actually learn to play games. In this paper, we design object-based input representations that generalize well across a number of video games. Using these representations, we evaluate an agent's ability to learn games similar to an infant - with limited world experience, employing simple inductive biases derived from intuitive representations of physics from the real world. Using such biases, we construct an object category representation to be used by a Q-learning algorithm and assess how well it learns to play multiple games based on observed object affordances. Our results suggest that a human-like object interaction setup capably learns to play several video games, and demonstrates superior generalizability, particularly for unfamiliar objects. Further exploring such methods will allow machines to learn in a human-centric way, thus incorporating more human-like learning benefits.

📄 PDF Abstract BibTeX arXiv:2409.13886

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingObjectQ-Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Investigating Human Priors for Playing Video Games

2018-02-28 · ICML 2018 7 · Rachit Dubey, Pulkit Agrawal, Deepak Pathak, Thomas L. Griffiths 외

What makes humans so good at solving seemingly complex video games? Unlike computers, humans bring in a great deal of prior knowledge about the world, enabling efficient decision making. This paper investigates the role …

Decision Making

LikePhys: Evaluating Intuitive Physics Understanding in Video Diffusion Models via Likelihood Preference

2025-10-13 · Jianhao Yuan, Fabio Pizzati, Francesco Pinto, Lars Kunze 외 arxiv

Intuitive physics understanding in video diffusion models plays an essential role in building general-purpose physically plausible world simulators, yet accurately evaluating such capacity remains a challenging task due …

WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actions

2025-05-23 · Zizhang Li, Hong-Xing Yu, Wei Liu, Yin Yang 외

WonderPlay is a novel framework integrating physics simulation with video generation for generating action-conditioned dynamic 3D scenes from a single image. While prior works are restricted to rigid body or simple elast…

SandScene GenerationVideo Generation

CLIP meets GamePhysics: Towards bug identification in gameplay videos using zero-shot transfer learning

2022-03-21 · Mohammad Reza Taesiri, Finlay Macklon, Cor-Paul Bezemer

Gameplay videos contain rich information about how players interact with the game and how the game responds. Sharing gameplay videos on social media platforms, such as Reddit, has become a common practice for many player…

Event DetectionTransfer Learning

Learning Physics Priors for Deep Reinforcement Learing

2018-09-27 · Yilun Du, Karthik Narasimhan

While model-based deep reinforcement learning (RL) holds great promise for sample efficiency and generalization, learning an accurate dynamics model is challenging and often requires substantial interactions with the env…

Deep Reinforcement LearningReinforcement Learning (RL)Transfer Learning