Deep Graph Convolutional Reinforcement Learning for Financial Portfolio Management -- DeepPocket
Portfolio management aims at maximizing the return on investment while minimizing risk by continuously reallocating the assets forming the portfolio. These assets are not independent but correlated during a short time period. A graph convolutional reinforcement learning framework called DeepPocket is proposed whose objective is to exploit the time-varying interrelations between financial instruments. These interrelations are represented by a graph whose nodes correspond to the financial instruments while the edges correspond to a pair-wise correlation function in between assets. DeepPocket consists of a restricted, stacked autoencoder for feature extraction, a convolutional network to collect underlying local information shared among financial instruments, and an actor-critic reinforcement learning agent. The actor-critic structure contains two convolutional networks in which the actor learns and enforces an investment policy which is, in turn, evaluated by the critic in order to determine the best course of action by constantly reallocating the various portfolio assets to optimize the expected return on investment. The agent is initially trained offline with online stochastic batching on historical data. As new data become available, it is trained online with a passive concept drift approach to handle unexpected changes in their distributions. DeepPocket is evaluated against five real-life datasets over three distinct investment periods, including during the Covid-19 crisis, and clearly outperformed market indexes.
Code (0)
등록된 구현이 없습니다.
Tasks
Managementreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
A Deep Reinforcement Learning Framework For Financial Portfolio Management
In this research paper, we investigate into a paper named "A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem" [arXiv:1706.10059]. It is a portfolio management problem which is solved …
Deep Reinforcement LearningManagementreinforcement-learningReinforcement LearningA Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem
Financial portfolio management is the process of constant redistribution of a fund into different financial products. This paper presents a financial-model-free Reinforcement Learning framework to provide a deep machine …
Deep Reinforcement LearningManagementPortfolio Optimizationreinforcement-learning+2A Novel Experts Advice Aggregation Framework Using Deep Reinforcement Learning for Portfolio Management
Solving portfolio management problems using deep reinforcement learning has been getting much attention in finance for a few years. We have proposed a new method using experts signals and historical price data to feed in…
Deep Reinforcement LearningManagementreinforcement-learningReinforcement Learning+1Cryptocurrency Portfolio Management with Deep Reinforcement Learning
Portfolio management is the decision-making process of allocating an amount of fund into different financial investment products. Cryptocurrencies are electronic and decentralized alternatives to government-issued money,…
Decision MakingDeep Reinforcement LearningManagementreinforcement-learning+2A General Framework on Enhancing Portfolio Management with Reinforcement Learning
Portfolio management is the art and science in fiance that concerns continuous reallocation of funds and assets across financial instruments to meet the desired returns to risk profile. Deep reinforcement learning (RL) h…
Asset ManagementDeep Reinforcement LearningManagementreinforcement-learning+2