Adversarial Attacks on Deep Algorithmic Trading Policies

2020-10-22 · Yaser Faghan, Nancirose Piazza, Vahid Behzadan, Ali Fathi

Deep Reinforcement Learning (DRL) has become an appealing solution to algorithmic trading such as high frequency trading of stocks and cyptocurrencies. However, DRL have been shown to be susceptible to adversarial attacks. It follows that algorithmic trading DRL agents may also be compromised by such adversarial techniques, leading to policy manipulation. In this paper, we develop a threat model for deep trading policies, and propose two attack techniques for manipulating the performance of such policies at test-time. Furthermore, we demonstrate the effectiveness of the proposed attacks against benchmark and real-world DQN trading agents.

📄 PDF Abstract BibTeX arXiv:2010.11388

Code (0)

등록된 구현이 없습니다.

Tasks

Algorithmic TradingDeep Reinforcement Learningreinforcement-learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

Adversarial Attacks on Machine Learning Systems for High-Frequency Trading

2020-02-21 · Micah Goldblum, Avi Schwarzschild, Ankit B. Patel, Tom Goldstein

Algorithmic trading systems are often completely automated, and deep learning is increasingly receiving attention in this domain. Nonetheless, little is known about the robustness properties of these models. We study val…

Algorithmic Trading BIG-bench Machine Learning Vocal Bursts Intensity Prediction

An overall view of key problems in algorithmic trading and recent progress

2020-06-09 · Michaël Karpe

We summarize the fundamental issues at stake in algorithmic trading, and the progress made in this field over the last twenty years. We first present the key problems of algorithmic trading, describing the concepts of op…

Algorithmic Trading BIG-bench Machine Learning reinforcement-learning Reinforcement Learning+1

Taking Over the Stock Market: Adversarial Perturbations Against Algorithmic Traders

2020-10-19 · Elior Nehemya, Yael Mathov, Asaf Shabtai, Yuval Elovici

In recent years, machine learning has become prevalent in numerous tasks, including algorithmic trading. Stock market traders utilize machine learning models to predict the market's behavior and execute an investment str…

Adversarial Attack Algorithmic Trading BIG-bench Machine Learning Inference Attack+1

Implicit Poisoning Attacks in Two-Agent Reinforcement Learning: Adversarial Policies for Training-Time Attacks

2023-02-27 · Mohammad Mohammadi, Jonathan Nöther, Debmalya Mandal, Adish Singla 외

In targeted poisoning attacks, an attacker manipulates an agent-environment interaction to force the agent into adopting a policy of interest, called target policy. Prior work has primarily focused on attacks that modify…

Targeted Adversarial Attacks on Deep Reinforcement Learning Policies via Model Checking

2022-12-10 · Dennis Gross, Thiago D. Simao, Nils Jansen, Guillermo A. Perez

Deep Reinforcement Learning (RL) agents are susceptible to adversarial noise in their observations that can mislead their policies and decrease their performance. However, an adversary may be interested not only in decre…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)