paper-with-me

홈 › Papers

A New Approach to Drifting Games, Based on Asymptotically Optimal Potentials

2022-07-23 · Zhilei Wang, Robert V. Kohn

We develop a new approach to drifting games, a class of two-person games with many applications to boosting and online learning settings. Our approach involves (a) guessing an asymptotically optimal potential by solving an associated partial differential equation (PDE); then (b) justifying the guess, by proving upper and lower bounds on the final-time loss whose difference scales like a negative power of the number of time steps. The proofs of our potential-based upper bounds are elementary, using little more than Taylor expansion. The proofs of our potential-based lower bounds are also elementary, combining Taylor expansion with probabilistic or combinatorial arguments. Not only is our approach more elementary, but we give new potentials and derive corresponding upper and lower bounds that match each other in the asymptotic regime.

📄 PDF Abstract BibTeX arXiv:2207.11405

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Drifting-Games Analysis for Online Learning and Applications to Boosting

2014-06-07 · NeurIPS 2014 12 · Haipeng Luo, Robert E. Schapire

We provide a general mechanism to design online learning algorithms based on a minimax analysis within a drifting-games framework. Different online learning settings (Hedge, multi-armed bandit problems and online convex …

On the iterated estimation of dynamic discrete choice games

2020-05-24

We study the asymptotic properties of a class of estimators of the structural parameters in dynamic discrete choice games. We consider K-stage policy iteration (PI) estimators, where K denotes the number of policy iterat…

Receding-Horizon Control via Drifting Models

2026-04-06 · Daniele Foffano, Alessio Russo, Alexandre Proutiere arxiv

We study the problem of trajectory optimization in settings where the system dynamics are unknown and it is not possible to simulate trajectories through a surrogate model. When an offline dataset of trajectories is avai…

The equilibrium properties of obvious strategy profiles in games with many players

2024-10-29 · Enxian Chen Bin Wu Hanping Xu

This paper studies the equilibrium properties of the ``obvious strategy profile'' in large finite-player games. Each player in such a strategy profile simply adopts a randomized strategy as she would have used in a symme…

Provably Fast Convergence of Independent Natural Policy Gradient for Markov Potential Games

2023-09-21 · NeurIPS 2023 11

This work studies an independent natural policy gradient (NPG) algorithm for the multi-agent reinforcement learning problem in Markov potential games. It is shown that, under mild technical assumptions and the introducti…