FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance

2021-11-07 · Xiao-Yang Liu, Hongyang Yang, Jiechao Gao, Christina Dan Wang

Deep reinforcement learning (DRL) has been envisioned to have a competitive edge in quantitative finance. However, there is a steep development curve for quantitative traders to obtain an agent that automatically positions to win in the market, namely \textit{to decide where to trade, at what price} and \textit{what quantity}, due to the error-prone programming and arduous debugging. In this paper, we present the first open-source framework \textit{FinRL} as a full pipeline to help quantitative traders overcome the steep learning curve. FinRL is featured with simplicity, applicability and extensibility under the key principles, \textit{full-stack framework, customization, reproducibility} and \textit{hands-on tutoring}. Embodied as a three-layer architecture with modular structures, FinRL implements fine-tuned state-of-the-art DRL algorithms and common reward functions, while alleviating the debugging workloads. Thus, we help users pipeline the strategy design at a high turnover rate. At multiple levels of time granularity, FinRL simulates various markets as training environments using historical data and live trading APIs. Being highly extensible, FinRL reserves a set of user-import interfaces and incorporates trading constraints such as market friction, market liquidity and investor's risk-aversion. Moreover, serving as practitioners' stepping stones, typical trading tasks are provided as step-by-step tutorials, e.g., stock trading, portfolio allocation, cryptocurrency trading, etc.

📄 PDF Abstract BibTeX arXiv:2111.09395

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningFrictionreinforcement-learning Reinforcement Learning (RL)

FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance

2020-11-19 · Xiao-Yang Liu, Hongyang Yang, Qian Chen, Runjia Zhang 외

As deep reinforcement learning (DRL) has been recognized as an effective approach in quantitative finance, getting hands-on experiences is attractive to beginners. However, to train a practical DRL trading agent that dec…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)Stock Market Prediction

FinRL-X: An AI-Native Modular Infrastructure for Quantitative Trading

2026-03-22 · Hongyang Yang, Boyu Zhang, Yang She, Xinyu Liao 외 arxiv

We present FinRL-X, a modular and deployment-consistent trading architecture that unifies data processing, strategy construction, backtesting, and broker execution under a weight-centric interface. While existing open-so…

Reinforcement Learning

FinRL-Podracer: High Performance and Scalable Deep Reinforcement Learning for Quantitative Finance

2021-11-07 · Zechu Li, Xiao-Yang Liu, Jiahao Zheng, Zhaoran Wang 외

Machine learning techniques are playing more and more important roles in finance market investment. However, finance quantitative modeling with conventional supervised learning approaches has a number of limitations. The…

Deep Reinforcement Learning GPU reinforcement-learning Reinforcement Learning+3

Safe-FinRL: A Low Bias and Variance Deep Reinforcement Learning Implementation for High-Freq Stock Trading

2022-06-13 · Zitao Song, Xuyang Jin, Chenliang Li

In recent years, many practitioners in quantitative finance have attempted to use Deep Reinforcement Learning (DRL) to build better quantitative trading (QT) strategies. Nevertheless, many existing studies fail to addres…

Deep Reinforcement Learning Time Series Time Series Analysis

FinRL-Meta: A Universe of Near-Real Market Environments for Data-Driven Deep Reinforcement Learning in Quantitative Finance

2021-12-13 · Xiao-Yang Liu, Jingyang Rui, Jiechao Gao, Liuqing Yang 외

Deep reinforcement learning (DRL) has shown huge potentials in building financial market simulators recently. However, due to the highly complex and dynamic nature of real-world markets, raw historical financial data oft…

Deep Reinforcement Learning GPU reinforcement-learning Reinforcement Learning+1