paper-with-me

홈 › Papers

Two-Fidelity Best-Action Identification for Stochastic Minimax Tree

2026-06-01 · Peter Chen, Xi Chen arxiv

We study fixed-confidence best-action identification (BAI) in stochastic minimax trees. This problem is increasingly relevant in modern AI planning, where deep minimax search and Monte Carlo Tree Search (MCTS) with language model long rollouts face a fundamental tradeoff: heuristic evaluations are cheap but biased, while accurate rollouts are reliable but prohibitively expensive. We propose 2FFS, a two-fidelity tree-search algorithm that brings multi-fidelity flat bandit ideas into trees. The algorithm combines minimax-style fast expansion with MCTS-style stochastic sampling, adaptively deciding when to exploit cheap biased evaluations and when to invoke expensive accurate evaluations for local certification. We prove fixed-confidence correctness, establish finite stopping for exact identification, and give a polynomial-depth cost upper bound for general-depth trees. Across numerical stochastic-tree experiments, 2FFS uses substantially fewer samples and computational operations comparing to existing BAI-MCTS baseline.

📄 PDF Abstract BibTeX arXiv:2606.01708

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Instance-optimal PAC Algorithms for Contextual Bandits

2022-07-05 · Zhaoqi Li, Lillian Ratliff, Houssam Nassif, Kevin Jamieson 외

In the stochastic contextual bandit setting, regret-minimizing algorithms have been extensively researched, but their instance-minimizing best-arm identification counterparts remain seldom studied. In this work, we focus…

Multi-Armed Bandits

Neyman allocation is minimax optimal for best arm identification with two arms

2022-04-12 · Karun Adusumilli

This note describes the optimal policy rule, according to the local asymptotic minimax regret criterion, for best arm identification when there are only two treatments. It is shown that the optimal sampling rule is the N…

Secure Best Arm Identification in the Presence of a Copycat

2025-07-25 · Asaf Cohen, Onur Günlü arxiv

Consider the problem of best arm identification with a security constraint. Specifically, assume a setup of stochastic linear bandits with $K$ arms of dimension $d$. In each arm pull, the player receives a reward that is…

An accelerated first-order regularized momentum descent ascent algorithm for stochastic nonconvex-concave minimax problems

2023-10-24 · Huiling Zhang, Zi Xu

Stochastic nonconvex minimax problems have attracted wide attention in machine learning, signal processing and many other fields in recent years. In this paper, we propose an accelerated first-order regularized momentum …

Minimax Optimal Fixed-Budget Best Arm Identification in Linear Bandits

2021-05-27 · Junwen Yang, Vincent Y. F. Tan

We study the problem of best arm identification in linear bandits in the fixed-budget setting. By leveraging properties of the G-optimal design and incorporating it into the arm allocation rule, we design a parameter-fre…