Learning to steer with Brownian noise
This paper considers an ergodic version of the bounded velocity follower problem, assuming that the decision maker lacks knowledge of the underlying system parameters and must learn them while simultaneously controlling. We propose algorithms based on moving empirical averages and develop a framework for integrating statistical methods with stochastic control theory. Our primary result is a logarithmic expected regret rate. To achieve this, we conduct a rigorous analysis of the ergodic convergence rates of the underlying processes and the risks of the considered estimators.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Brownian Noise Reduction: Maximizing Privacy Subject to Accuracy Constraints
There is a disconnect between how researchers and practitioners handle privacy-utility tradeoffs. Researchers primarily operate from a privacy first perspective, setting strict privacy requirements and minimizing risk su…
Tight Regret Bounds for Noisy Optimization of a Brownian Motion
We consider the problem of Bayesian optimization of a one-dimensional Brownian motion in which the $T$ adaptively chosen observations are corrupted by Gaussian noise. We show that as the smallest possible expected cumula…
Bayesian OptimizationTwo-sample testingDetecting discrete processes with the Epps effect
The Epps effect is key phenomenology relating to high frequency correlation dynamics in financial markets. We argue that it can be used to provide insight into whether tick data is best represented as samples from Browni…
Point ProcessesModeling a Financial System with Memory via Fractional Calculus and Fractional Brownian Motion
Financial markets have long since been modeled using stochastic methods such as Brownian motion, and more recently, rough volatility models have been built using fractional Brownian motion. This fractional aspect brings …
Estimation of bid-ask spreads in the presence of serial dependence
Starting from a basic model in which the dynamic of the transaction prices is a geometric Brownian motion disrupted by a microstructure white noise, corresponding to the random alternation of bids and asks, we propose mo…