paper-with-me

Papers

Learning Models of Individual Behavior in Chess

2020-08-23 · Reid McIlroy-Young, Russell Wang, Siddhartha Sen, Jon Kleinberg, Ashton Anderson

AI systems that can capture human-like behavior are becoming increasingly useful in situations where humans may want to learn from these systems, collaborate with them, or engage with them as partners for an extended duration. In order to develop human-oriented AI systems, the problem of predicting human actions -- as opposed to predicting optimal actions -- has received considerable attention. Existing work has focused on capturing human behavior in an aggregate sense, which potentially limits the benefit any particular individual could gain from interaction with these systems. We extend this line of work by developing highly accurate predictive models of individual human behavior in chess. Chess is a rich domain for exploring human-AI interaction because it combines a unique set of properties: AI systems achieved superhuman performance many years ago, and yet humans still interact with them closely, both as opponents and as preparation tools, and there is an enormous corpus of recorded data on individual player games. Starting with Maia, an open-source version of AlphaZero trained on a population of human players, we demonstrate that we can significantly improve prediction accuracy of a particular player's moves by applying a series of fine-tuning methods. Furthermore, our personalized models can be used to perform stylometry -- predicting who made a given set of moves -- indicating that they capture human decision-making at an individual level. Our work demonstrates a way to bring AI systems into better alignment with the behavior of individual people, which could lead to large improvements in human-AI interaction.

📄 PDF Abstract BibTeX arXiv:2008.10086

Code (1)

csslab/maia-individual 공식 구현

Tasks

Decision Making

Methods 이 논문이 사용한 방법론

AlphaZero AlphaZero is a reinforcement learning agent for playing board games such as Go, chess, and shogi.

Similar Papers 제목 키워드 기반

Learning to Imitate with Less: Efficient Individual Behavior Modeling in Chess

2025-07-29 · Zhenwei Tang, Difan Jiao, Eric Xue, Reid McIlroy-Young 외 arxiv

As humans seek to collaborate with, learn from, and better understand artificial intelligence systems, developing AIs that can accurately emulate individual decision-making becomes increasingly important. Chess, a long-s…

Detecting Individual Decision-Making Style: Exploring Behavioral Stylometry in Chess

2022-08-02 · NeurIPS 2021 12 · Reid McIlroy-Young, Russell Wang, Siddhartha Sen, Jon Kleinberg 외

The advent of machine learning models that surpass human decision-making ability in complex domains has initiated a movement towards building AI systems that interact with humans. Many building blocks are essential for t…

Decision Making

Mixture of Masters: Sparse Chess Language Models with Player Routing

2026-02-04 · Giacomo Frisoni, Lorenzo Molfetta, Davide Freddi, Gianluca Moro arxiv

Modern chess language models are dense transformers trained on millions of games played by thousands of high-rated individuals. However, these monolithic networks tend to collapse into mode-averaged behavior, where styli…

Toward Modeling Player-Specific Chess Behaviors

2026-05-12 · Loris Sogliuzzo, Aloïs Rautureau, Eric Piette arxiv

While artificial intelligence has achieved superhuman performance in chess, developing models that accurately emulate the individualized decision-making styles of human players remains a significant challenge. Existing h…

Generative Modeling of Individual Behavior at Scale

2025-02-20 · Nabil Omi, Lucas Caccia, Anurag Sarkar, Jordan T. Ash 외

There has been a growing interest in using AI to model human behavior, particularly in domains where humans interact with this technology. While most existing work models human behavior at an aggregate level, our goal is…

Image GenerationMulti-Task Learningparameter-efficient fine-tuning