Advancing Algorithmic Trading: A Multi-Technique Enhancement of Deep Q-Network Models

2023-11-09 · Gang Hu

This study enhances a Deep Q-Network (DQN) trading model by incorporating advanced techniques like Prioritized Experience Replay, Regularized Q-Learning, Noisy Networks, Dueling, and Double DQN. Extensive tests on assets like BTC/USD and AAPL demonstrate superior performance compared to the original model, with marked increases in returns and Sharpe Ratio, indicating improved risk-adjusted rewards. Notably, convolutional neural network (CNN) architectures, both 1D and 2D, significantly boost returns, suggesting their effectiveness in market trend analysis. Across instruments, these enhancements have yielded stable and high gains, eclipsing the baseline and highlighting the potential of CNNs in trading systems. The study suggests that applying sophisticated deep learning within reinforcement learning can greatly enhance automated trading, urging further exploration into advanced methods for broader financial applicability. The findings advocate for the continued evolution of AI in finance.

📄 PDF Abstract BibTeX arXiv:2311.05743

Code (0)

등록된 구현이 없습니다.

Tasks

Algorithmic TradingQ-Learning

Methods 이 논문이 사용한 방법론

Double Q-learning Double Q-learning is an off-policy reinforcement learning algorithm that utilises double estimation to counteract overestimation problems with traditional Q-learning. The…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Double DQN 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Prioritized Experience Replay Prioritized Experience Replay is a type of experience replay in reinforcement learning where we more frequently replay…

Adversarial Attacks on Deep Algorithmic Trading Policies

2020-10-22 · Yaser Faghan, Nancirose Piazza, Vahid Behzadan, Ali Fathi

Deep Reinforcement Learning (DRL) has become an appealing solution to algorithmic trading such as high frequency trading of stocks and cyptocurrencies. However, DRL have been shown to be susceptible to adversarial attack…

Algorithmic Trading Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Taking Over the Stock Market: Adversarial Perturbations Against Algorithmic Traders

2020-10-19 · Elior Nehemya, Yael Mathov, Asaf Shabtai, Yuval Elovici

In recent years, machine learning has become prevalent in numerous tasks, including algorithmic trading. Stock market traders utilize machine learning models to predict the market's behavior and execute an investment str…

Adversarial Attack Algorithmic Trading BIG-bench Machine Learning Inference Attack+1

Enhancing literature review with LLM and NLP methods. Algorithmic trading case

2024-10-23 · Stanisław Łaniewski, Robert Ślepaczuk

This study utilizes machine learning algorithms to analyze and organize knowledge in the field of algorithmic trading. By filtering a dataset of 136 million research papers, we identified 14,342 relevant articles publish…

Algorithmic Trading Articles Dimensionality Reduction

An overall view of key problems in algorithmic trading and recent progress

2020-06-09 · Michaël Karpe

We summarize the fundamental issues at stake in algorithmic trading, and the progress made in this field over the last twenty years. We first present the key problems of algorithmic trading, describing the concepts of op…

Algorithmic Trading BIG-bench Machine Learning reinforcement-learning Reinforcement Learning+1

A Deep Reinforcement Learning Approach for Trading Optimization in the Forex Market with Multi-Agent Asynchronous Distribution

2024-05-30 · Davoud Sarani, Dr. Parviz Rashidi-Khazaee

In today's forex market traders increasingly turn to algorithmic trading, leveraging computers to seek more profits. Deep learning techniques as cutting-edge advancements in machine learning, capable of identifying patte…

Algorithmic Trading Deep Reinforcement Learning