MarketGPT: Developing a Pre-trained transformer (GPT) for Modeling Financial Time Series
This work presents a generative pre-trained transformer (GPT) designed for modeling financial time series. The GPT functions as an order generation engine within a discrete event simulator, enabling realistic replication of limit order book dynamics. Our model leverages recent advancements in large language models to produce long sequences of order messages in a steaming manner. Our results demonstrate that the model successfully reproduces key features of order flow data, even when the initial order flow prompt is no longer present within the model's context window. Moreover, evaluations reveal that the model captures several statistical properties, or 'stylized facts', characteristic of real financial markets and broader macro-scale data distributions. Collectively, this work marks a significant step toward creating high-fidelity, interactive market simulations.
Code (1)
Tasks
Time SeriesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Information Extraction: An application to the domain of hyper-local financial data on developing countries
Despite the need for financial data on company activities in developing countries for development research and economic analysis, such data does not exist. In this project, we develop and evaluate two Natural Language Pr…
NERRelationRelation ExtractionProsperAMnet at FinCausal 2020, Task 1 & 2: Modeling causality in financial texts using multi-headed transformers
This paper introduces our efforts at the FinCasual shared task for modeling causality in financial utterances. Our approach uses the commonly and successfully applied strategy of fine-tuning a transformer-based language …
Language ModelingLanguage ModellingPLUTUS: A Well Pre-trained Large Unified Transformer can Unveil Financial Time Series Regularities
Financial time series modeling is crucial for understanding and predicting market behaviors but faces challenges such as non-linearity, non-stationarity, and high noise levels. Traditional models struggle to capture comp…
Contrastive LearningTime SeriesPretrained LLM Adapted with LoRA as a Decision Transformer for Offline RL in Quantitative Trading
Developing effective quantitative trading strategies using reinforcement learning (RL) is challenging due to the high risks associated with online interaction with live financial markets. Consequently, offline RL, which …
Offline RLparameter-efficient fine-tuningQ-LearningReinforcement Learning (RL)Bridging Short- and Long-Term Dependencies: A CNN-Transformer Hybrid for Financial Time Series Forecasting
Time series forecasting is crucial for decision-making across various domains, particularly in financial markets where stock prices exhibit complex and non-linear behaviors. Accurately predicting future price movements i…
Decision MakingTime SeriesTime Series Forecasting