paper-with-me

홈 › Papers

Verification Based Solution for Structured MAB Problems

2016-12-01 · NeurIPS 2016 12 · Zohar S. Karnin

We consider the problem of finding the best arm in a stochastic Mutli-armed Bandit (MAB) game and propose a general framework based on verification that applies to multiple well-motivated generalizations of the classic MAB problem. In these generalizations, additional structure is known in advance, causing the task of verifying the optimality of a candidate to be easier than discovering the best arm. Our results are focused on the scenario where the failure probability $\delta$ must be very low; we essentially show that in this high confidence regime, identifying the best arm is as easy as the task of verification. We demonstrate the effectiveness of our framework by applying it, and improving the state-of-the art results in the problems of: Linear bandits, Dueling bandits with the Condorcet assumption, Copeland dueling bandits, Unimodal bandits and Graphical bandits.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

ReLoop: Structured Modeling and Behavioral Verification for Reliable LLM-Based Optimization

2026-02-17 · Junbo Jacob Lian, Yujun Sun, Huiling Chen, Chaoyu Zhang 외 arxiv

Large language models (LLMs) can translate natural language into optimization code, but silent failures pose a critical risk: code that executes and returns solver-feasible solutions may encode semantically incorrect for…

Learning Loop Invariants for Program Verification

2018-12-01 · NeurIPS 2018 12 · Xujie Si, Hanjun Dai, Mukund Raghothaman, Mayur Naik 외

A fundamental problem in program verification concerns inferring loop invariants. The problem is undecidable and even practical instances are challenging. Inspired by how human experts construct loop invariants, we propo…

Decision MakingHeuristic SearchReinforcement Learning

Exploring Decomposition for Table-based Fact Verification

2021-09-22 · Findings (EMNLP) 2021 11 · Xiaoyu Yang, Xiaodan Zhu

Fact verification based on structured data is challenging as it requires models to understand both natural language and symbolic operations performed over tables. Although pre-trained language models have demonstrated a …

Fact VerificationTable-based Fact Verification

When Verification Hurts: Asymmetric Effects of Multi-Agent Feedback in Logic Proof Tutoring

2026-03-28 · Tahreem Yasir, Sutapa Dey Tithi, Benyamin Tabarsi, Dmitri Droujkov 외 arxiv

Large language models (LLMs) are increasingly used for automated tutoring, but their reliability in structured symbolic domains remains unclear. We study step-level feedback for propositional logic proofs, which require …

Generic Diagonalizability, Structural Functional Observability and Output Controllability

2024-09-25 · Yuan Zhang, Tyrone Fernando, Mohamed Darouach

This paper investigates the structural functional observability (SFO) and structural output controllability (SOC) of a class of systems with generically diagonalizable state matrices and explores the associated minimal s…