paper-with-me

Papers

Closed Drafting as a Case Study for First-Principle Interpretability, Memory, and Generalizability in Deep Reinforcement Learning

2023-10-31 · Ryan Rezai, Jason Wang

Closed drafting or "pick and pass" is a popular game mechanic where each round players select a card or other playable element from their hand and pass the rest to the next player. In this paper, we establish first-principle methods for studying the interpretability, generalizability, and memory of Deep Q-Network (DQN) models playing closed drafting games. In particular, we use a popular family of closed drafting games called "Sushi Go Party", in which we achieve state-of-the-art performance. We fit decision rules to interpret the decision-making strategy of trained DRL agents by comparing them to the ranking preferences of different types of human players. As Sushi Go Party can be expressed as a set of closely-related games based on the set of cards in play, we quantify the generalizability of DRL models trained on various sets of cards, establishing a method to benchmark agent performance as a function of environment unfamiliarity. Using the explicitly calculable memory of other player's hands in closed drafting games, we create measures of the ability of DRL models to learn memory.

📄 PDF Abstract BibTeX arXiv:2310.20654

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDeep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Wind Tunnel Study of the Forces Due to Drafting in Dolphin Mother-Calf pairs

2024-11-09 · D Weihs, M Ringel

Cetacean Calves keep up with their mothers while rapidly swimming, by a hydrodynamical effect called drafting. This has been observed in the wild and enclosed areas, and has been mathematically analyzed in the past, but …

AutoSpec: An Agentic Framework for Automatically Drafting Patent Specification

2025-09-23 · Ryan Shea, Zhou Yu arxiv

Patents play a critical role in driving technological innovation by granting inventors exclusive rights to their inventions. However the process of drafting a patent application is often expensive and time-consuming, mak…

Large Language Models in Cryptocurrency Securities Cases: Can a GPT Model Meaningfully Assist Lawyers?

2023-08-11 · Arianna Trozze, Toby Davies, Bennett Kleinberg

Large Language Models (LLMs) could be a useful tool for lawyers. However, empirical research on their effectiveness in conducting legal tasks is scant. We study securities cases involving cryptocurrencies as one of numer…

Decision MakingLegal Reasoning

Using Covid-19 Response Policy to Estimate Open Water Swim Drafting Effects in Triathlon

2025-02-13 · Felix Reichel

This study investigates the causal effects of open-water swim drafting by leveraging a natural experiment induced by staggered race starts during the COVID-19 pandemic. Before 2020, athletes started in groups, enabling d…

CaseGen: A Benchmark for Multi-Stage Legal Case Documents Generation

2025-02-25 · Haitao Li, Jiaying Ye, Yiran Hu, Jia Chen 외

Legal case documents play a critical role in judicial proceedings. As the number of cases continues to rise, the reliance on manual drafting of legal case documents is facing increasing pressure and challenges. The devel…

Legal Reasoning