paper-with-me

Papers

A Minimalist Bayesian Framework for Stochastic Optimization

2025-09-07 · Kaizheng Wang arxiv

The Bayesian paradigm offers principled tools for sequential decision-making under uncertainty, but its reliance on a probabilistic model for all parameters can hinder the incorporation of complex structural constraints. We introduce a minimalist Bayesian framework that places a prior only on the component of interest, such as the location of the optimum. Nuisance parameters are eliminated via profile likelihood, which naturally handles constraints. As a direct instantiation, we develop a MINimalist Thompson Sampling (MINTS) algorithm. Our framework accommodates structured problems, including continuum-armed Lipschitz bandits and dynamic pricing. It also provides a probabilistic lens on classical convex optimization algorithms such as the center of gravity and ellipsoid methods. We further analyze MINTS for multi-armed bandits and establish near-optimal regret guarantees.

📄 PDF Abstract BibTeX arXiv:2509.07030

Code (0)

등록된 구현이 없습니다.

Tasks

Stochastic OptimizationMulti-Armed Bandits

Similar Papers 제목 키워드 기반

Grammar Induction for Minimalist Grammars using Variational Bayesian Inference : A Technical Report

2017-10-31 · Eva Portelance, Amelia Bruno, Daniel Harasim, Leon Bergen 외

The following technical report presents a formal approach to probabilistic minimalist grammar parameter estimation. We describe a formalization of a minimalist grammar. We then present an algorithm for the application of…

Bayesian Inferenceparameter estimation

MINTS: Minimalist Thompson Sampling

2026-06-01 · Kaizheng Wang arxiv

The Bayesian paradigm offers principled tools for sequential decision-making under uncertainty, but its reliance on a probabilistic model for all parameters can hinder the incorporation of complex structural constraints.…

Multi-Armed Bandits

Designing over uncertain outcomes with stochastic sampling Bayesian optimization

2019-11-05 · Peter D. Tonner, Daniel V. Samarov, A. Gilad Kusne

Optimization is becoming increasingly common in scientific and engineering domains. Oftentimes, these problems involve various levels of stochasticity or uncertainty in generating proposed solutions. Therefore, optimizat…

Bayesian OptimizationDecision Making

Bayesian Joint Chance Constrained Optimization: Approximations and Statistical Consistency

2021-06-23 · Prateek Jaiswal, Harsha Honnappa, Vinayak A. Rao

This paper considers data-driven chance-constrained stochastic optimization problems in a Bayesian framework. Bayesian posteriors afford a principled mechanism to incorporate data and prior knowledge into stochastic opti…

Stochastic Optimization

A Minimalist Example of Edge-of-Stability and Progressive Sharpening

2025-03-04 · LiMing Liu, Zixuan Zhang, Simon Du, Tuo Zhao

Recent advances in deep learning optimization have unveiled two intriguing phenomena under large learning rates: Edge of Stability (EoS) and Progressive Sharpening (PS), challenging classical Gradient Descent (GD) analys…