FlowOE: Imitation Learning with Flow Policy from Ensemble RL Experts for Optimal Execution under Heston Volatility and Concave Market Impacts

2025-06-06 · Yang Li, Zhi Chen

Optimal execution in financial markets refers to the process of strategically transacting a large volume of assets over a period to achieve the best possible outcome by balancing the trade-off between market impact costs and timing or volatility risks. Traditional optimal execution strategies, such as static Almgren-Chriss models, often prove suboptimal in dynamic financial markets. This paper propose flowOE, a novel imitation learning framework based on flow matching models, to address these limitations. FlowOE learns from a diverse set of expert traditional strategies and adaptively selects the most suitable expert behavior for prevailing market conditions. A key innovation is the incorporation of a refining loss function during the imitation process, enabling flowOE not only to mimic but also to improve upon the learned expert actions. To the best of our knowledge, this work is the first to apply flow matching models in a stochastic optimal execution problem. Empirical evaluations across various market conditions demonstrate that flowOE significantly outperforms both the specifically calibrated expert models and other traditional benchmarks, achieving higher profits with reduced risk. These results underscore the practical applicability and potential of flowOE to enhance adaptive optimal execution.

📄 PDF Abstract BibTeX arXiv:2506.05755

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Preventing Imitation Learning with Adversarial Policy Ensembles

2020-01-31 · Albert Zhan, Stas Tiomkin, Pieter Abbeel

Imitation learning can reproduce policies by observing experts, which poses a problem regarding policy privacy. Policies, such as human, or policies on deployed robots, can all be cloned without consent from the owners. …

Imitation Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Bayesian Residual Policy Optimization: Scalable Bayesian Reinforcement Learning with Clairvoyant Experts

2020-02-07 · Gilwoo Lee, Brian Hou, Sanjiban Choudhury, Siddhartha S. Srinivasa

Informed and robust decision making in the face of uncertainty is critical for robots that perform physical tasks alongside people. We formulate this as Bayesian Reinforcement Learning over latent Markov Decision Process…

Decision Making Policy Gradient Methods reinforcement-learning Reinforcement Learning+1

IALE: Imitating Active Learner Ensembles

2020-07-09 · Christoffer Löffler, Christopher Mutschler

Active learning (AL) prioritizes the labeling of the most informative data samples. However, the performance of AL heuristics depends on the structure of the underlying classifier model and the data. We propose an imitat…

Active Learning Imitation Learning

DOPPLER: Dual-Policy Learning for Device Assignment in Asynchronous Dataflow Graphs

2025-05-29 · Xinyu Yao, Daniel Bourgeois, Abhinav Jain, Yuxin Tang 외

We study the problem of assigning operations in a dataflow graph to devices to minimize execution time in a work-conserving system, with emphasis on complex machine learning workloads. Prior learning-based methods often …

Scheduling

Periodic Intra-Ensemble Knowledge Distillation for Reinforcement Learning

2020-02-01 · Zhang-Wei Hong, Prabhat Nagarajan, Guilherme Maeda

Off-policy ensemble reinforcement learning (RL) methods have demonstrated impressive results across a range of RL benchmark tasks. Recent works suggest that directly imitating experts' policies in a supervised manner bef…

Knowledge Distillation MuJoCo reinforcement-learning Reinforcement Learning+1