Deep reinforcement learning for time series: playing idealized trading games
Deep Q-learning is investigated as an end-to-end solution to estimate the optimal strategies for acting on time series input. Experiments are conducted on two idealized trading games. 1) Univariate: the only input is a wave-like price time series, and 2) Bivariate: the input includes a random stepwise price time series and a noisy signal time series, which is positively correlated with future price changes. The Univariate game tests whether the agent can capture the underlying dynamics, and the Bivariate game tests whether the agent can utilize the hidden relation among the inputs. Stacked Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM) units, Convolutional Neural Network (CNN), and multi-layer perceptron (MLP) are used to model Q values. For both games, all agents successfully find a profitable strategy. The GRU-based agents show best overall performance in the Univariate game, while the MLP-based agents outperform others in the Bivariate game.
Code (2)
Tasks
Deep Reinforcement LearningQ-Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Time SeriesTime Series AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DDPG based on multi-scale strokes for financial time series trading strategy
With the development of artificial intelligence,more and more financial practitioners apply deep reinforcement learning to financial trading strategies.However,It is difficult to extract accurate features due to the char…
Deep Reinforcement LearningQ-Learningreinforcement-learningReinforcement Learning+3Sentiment and Knowledge Based Algorithmic Trading with Deep Reinforcement Learning
Algorithmic trading, due to its inherent nature, is a difficult problem to tackle; there are too many variables involved in the real world which make it almost impossible to have reliable algorithms for automated stock t…
Algorithmic TradingDeep Reinforcement LearningKnowledge Graphsreinforcement-learning+4FinRL-Podracer: High Performance and Scalable Deep Reinforcement Learning for Quantitative Finance
Machine learning techniques are playing more and more important roles in finance market investment. However, finance quantitative modeling with conventional supervised learning approaches has a number of limitations. The…
Deep Reinforcement LearningGPUreinforcement-learningReinforcement Learning+3Deep reinforcement learning on a multi-asset environment for trading
Financial trading has been widely analyzed for decades with market participants and academics always looking for advanced methods to improve trading performance. Deep reinforcement learning (DRL), a recently reinvigorate…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Financial News-Driven LLM Reinforcement Learning for Portfolio Management
Reinforcement learning (RL) has emerged as a transformative approach for financial trading, enabling dynamic strategy optimization in complex markets. This study explores the integration of sentiment analysis, derived fr…
Decision MakingManagementreinforcement-learningReinforcement Learning+2