paper-with-me

홈 › Papers

FLAG-Trader: Fusion LLM-Agent with Gradient-based Reinforcement Learning for Financial Trading

2025-02-17 · Guojun Xiong, Zhiyang Deng, Keyi Wang, Yupeng Cao, Haohang Li, Yangyang Yu, Xueqing Peng, Mingquan Lin, Kaleb E Smith, Xiao-Yang Liu, Jimin Huang, Sophia Ananiadou, Qianqian Xie

Large language models (LLMs) fine-tuned on multimodal financial data have demonstrated impressive reasoning capabilities in various financial tasks. However, they often struggle with multi-step, goal-oriented scenarios in interactive financial markets, such as trading, where complex agentic approaches are required to improve decision-making. To address this, we propose \textsc{FLAG-Trader}, a unified architecture integrating linguistic processing (via LLMs) with gradient-driven reinforcement learning (RL) policy optimization, in which a partially fine-tuned LLM acts as the policy network, leveraging pre-trained knowledge while adapting to the financial domain through parameter-efficient fine-tuning. Through policy gradient optimization driven by trading rewards, our framework not only enhances LLM performance in trading but also improves results on other financial-domain tasks. We present extensive empirical evidence to validate these enhancements.

📄 PDF Abstract BibTeX arXiv:2502.11433

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Makingparameter-efficient fine-tuningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

When AI Trading Agents Compete: Adverse Selection of Meta-Orders by Reinforcement Learning-Based Market Making

2025-10-31 · Ali Raza Jafree, Konark Jain, Nick Firoozye arxiv

We investigate the mechanisms by which medium-frequency trading agents are adversely selected by opportunistic high-frequency traders. We use reinforcement learning (RL) within a Hawkes Limit Order Book (LOB) model in or…

Reinforcement Learning

Neuro-Symbolic Traders: Assessing the Wisdom of AI Crowds in Markets

2024-10-18 · Namid R. Stillman, Rory Baggott

Deep generative models are becoming increasingly used as tools for financial analysis. However, it is unclear how these models will influence financial markets, especially when they infer financial value in a semi-autono…

Financial Analysis

MetaTrader: An Reinforcement Learning Approach Integrating Diverse Policies for Portfolio Optimization

2022-09-01 · Hui Niu, Siyuan Li, Jian Li

Portfolio management is a fundamental problem in finance. It involves periodic reallocations of assets to maximize the expected returns within an appropriate level of risk exposure. Deep reinforcement learning (RL) has b…

Decision MakingDeep Reinforcement LearningImitation LearningManagement+4

Hierarchical Reinforced Trader (HRT): A Bi-Level Approach for Optimizing Stock Selection and Execution

2024-10-19 · Zijie Zhao, Roy E. Welsch

Leveraging Deep Reinforcement Learning (DRL) in automated stock trading has shown promising results, yet its application faces significant challenges, including the curse of dimensionality, inertia in trading actions, an…

Deep Reinforcement LearningHierarchical Reinforcement Learningreinforcement-learningReinforcement Learning

Reinforcement Learning for Corporate Bond Trading: A Sell Side Perspective

2024-06-18 · Samuel Atkins, Ali Fathi, Sammy Assefa

A corporate bond trader in a typical sell side institution such as a bank provides liquidity to the market participants by buying/selling securities and maintaining an inventory. Upon receiving a request for a buy/sell p…

reinforcement-learningReinforcement Learning