Human-Aligned Procedural Level Generation Reinforcement Learning via Text-Level-Sketch Shared Representation
Human-aligned AI is a critical component of co-creativity, as it enables models to accurately interpret human intent and generate controllable outputs that align with design goals in collaborative content creation. This direction is especially relevant in procedural content generation via reinforcement learning (PCGRL), which is intended to serve as a tool for human designers. However, existing systems often fall short of exhibiting human-centered behavior, limiting the practical utility of AI-driven generation tools in real-world design workflows. In this paper, we propose VIPCGRL (Vision-Instruction PCGRL), a novel deep reinforcement learning framework that incorporates three modalities-text, level, and sketches-to extend control modality and enhance human-likeness. We introduce a shared embedding space trained via quadruple contrastive learning across modalities and human-AI styles, and align the policy using an auxiliary reward based on embedding similarity. Experimental results show that VIPCGRL outperforms existing baselines in human-likeness, as validated by both quantitative metrics and human evaluations. The code and dataset are available at https://github.com/bic4907/VIPCGRL.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement LearningContrastive LearningSimilar Papers 제목 키워드 기반
Illuminating Generalization in Deep Reinforcement Learning through Procedural Level Generation
Deep reinforcement learning (RL) has shown impressive results in a variety of domains, learning directly from high-dimensional sensory streams. However, when neural networks are trained in a fixed environment, such as a …
ClusteringDeep Reinforcement LearningDimensionality Reductionreinforcement-learning+2IPCGRL: Language-Instructed Reinforcement Learning for Procedural Level Generation
Recent research has highlighted the significance of natural language in enhancing the controllability of generative models. While various efforts have been made to leverage natural language for content generation, resear…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningSentence+2PCGRL: Procedural Content Generation via Reinforcement Learning
We investigate how reinforcement learning can be used to train level-designing agents. This represents a new approach to procedural content generation in games, where level design is framed as a game, and the content gen…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Online Game Level Generation from Music
Game consists of multiple types of content, while the harmony of different content types play an essential role in game design. However, most works on procedural content generation consider only one type of content at a …
Game Designreinforcement-learningReinforcement LearningReinforcement Learning (RL)Combining Evolutionary Search with Behaviour Cloning for Procedurally Generated Content
In this work, we consider the problem of procedural content generation for video game levels. Prior approaches have relied on evolutionary search (ES) methods capable of generating diverse levels, but this generation pro…
Reinforcement Learning (RL)valid