From open learners to open games
The categories of open learners (due to Fong, Spivak and Tuy\'eras) and open games (due to the present author, Ghani, Winschel and Zahn) bear a very striking and unexpected similarity. The purpose of this short note is to prove that there is a faithful symmetric monoidal functor from the former to the latter, which means that any supervised neural network (without feedback or other complicating features) can be seen as an open game in a canonical way. Roughly, each parameter is controlled by a different player, and the game's best response relation encodes the dynamics of gradient descent. We suggest paths for further work exploiting the link.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Detecting and Adapting to Novelty in Games
Open-world novelty occurs when the rules of an environment can change abruptly, such as when a game player encounters "house rules". To address open-world novelty, game playing agents must be able to detect when novelty …
Knowledge GraphsModel-based Reinforcement Learningreinforcement-learningReinforcement Learning (RL)LLM-Generated Feedback Supports Learning If Learners Choose to Use It
Large language models (LLMs) are increasingly used to generate feedback, yet their impact on learning remains underexplored, especially compared to existing feedback methods. This study investigates how on-demand LLM-gen…
Selection biasStrategizing against No-Regret Learners in First-Price Auctions
We study repeated first-price auctions and general repeated Bayesian games between two players, where one player, the learner, employs a no-regret learning algorithm, and the other player, the optimizer, knowing the lear…
Deep Reinforcement Learning for Autonomous Cyber Defence: A Survey
The rapid increase in the number of cyber-attacks in recent years raises the need for principled methods for defending networks against malicious actors. Deep reinforcement learning (DRL) has emerged as a promising appro…
BenchmarkingDeep Reinforcement LearningReal-Time Strategy Gamesreinforcement-learning+2Who Killed Albert Einstein? From Open Data to Murder Mystery Games
This paper presents a framework for generating adventure games from open data. Focusing on the murder mystery type of adventure games, the generator is able to transform open data from Wikipedia articles, OpenStreetMap a…
Articles