Towards Game-based Metrics for Computational Co-creativity
We propose the following question: what game-like interactive system would provide a good environment for measuring the impact and success of a co-creative, cooperative agent? Creativity is often formulated in terms of novelty, value, surprise and interestingness. We review how these concepts are measured in current computational intelligence research and provide a mapping from modern electronic and tabletop games to open research problems in mixed-initiative systems and computational co-creativity. We propose application scenarios for future research, and a number of metrics under which the performance of cooperative agents in these environments will be evaluated.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Controllable Co-Creative Agent for Game System Design
Many advancements have been made in procedural content generation for games, and with mixed-initiative co-creativity, have the potential for great benefits to human designers. However, co-creative systems for game genera…
Design-Driven Requirements for Computationally Co-Creative Game AI Design Tools
Game AI designers must manage complex interactions between the AI character, the game world, and the player, while achieving their design visions. Computational co-creativity tools can aid them, but first, AI and HCI res…
A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Models
Recently, numerous benchmarks have been developed to evaluate the logical reasoning abilities of large language models (LLMs). However, assessing the equally important creative capabilities of LLMs is challenging due to …
Logical ReasoningEvaluating Creativity and Deception in Large Language Models: A Simulation Framework for Multi-Agent Balderdash
Large Language Models (LLMs) have shown impressive capabilities in complex tasks and interactive environments, yet their creativity remains underexplored. This paper introduces a simulation framework utilizing the game B…
Logical ReasoningEvaluating Creativity in Computational Co-Creative Systems
This paper provides a framework for evaluating creativity in co-creative systems: those that involve computer programs collaborating with human users on creative tasks. We situate co-creative systems within a broader con…