Context-Aware Language Models for Forecasting Market Impact from Sequences of Financial News
Financial news plays a critical role in the information diffusion process in financial markets and is a known driver of stock prices. However, the information in each news article is not necessarily self-contained, often requiring a broader understanding of the historical news coverage for accurate interpretation. Further, identifying and incorporating the most relevant contextual information presents significant challenges. In this work, we explore the value of historical context in the ability of large language models to understand the market impact of financial news. We find that historical context provides a consistent and significant improvement in performance across methods and time horizons. To this end, we propose an efficient and effective contextualization method that uses a large LM to process the main article, while a small LM encodes the historical context into concise summary embeddings that are then aligned with the large model's representation space. We explore the behavior of the model through multiple qualitative and quantitative interpretability tests and reveal insights into the value of contextualization. Finally, we demonstrate that the value of historical context in model predictions has real-world applications, translating to substantial improvements in simulated investment performance.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Market-Derived Financial Sentiment Analysis: Context-Aware Language Models for Crypto Forecasting
Financial Sentiment Analysis (FSA) traditionally relies on human-annotated sentiment labels to infer investor sentiment and forecast market movements. However, inferring the potential market impact of words based on thei…
Financial Tweet PredictionLanguage ModelingLanguage ModellingSentiment Analysis+1Regime-aware financial volatility forecasting via in-context learning
This work introduces a regime-aware in-context learning framework that leverages large language models (LLMs) for financial volatility forecasting under nonstationary market conditions. The proposed approach deploys pret…
One-Shot LearningPre-Finetuning with Impact Duration Awareness for Stock Movement Prediction
Understanding the duration of news events' impact on the stock market is crucial for effective time-series forecasting, yet this facet is largely overlooked in current research. This paper addresses this research gap by …
Sentiment AnalysisTime SeriesTime Series ForecastingContext-Aware Probabilistic Modeling with LLM for Multimodal Time Series Forecasting
Time series forecasting is important for applications spanning energy markets, climate analysis, and traffic management. However, existing methods struggle to effectively integrate exogenous texts and align them with the…
Time SeriesTime Series ForecastingQuantifying Event Impacts on Time Series via Multiscale Contrastive Learning
Shocks that spread through the web, such as cybersecurity breach disclosures, can abruptly disrupt financial time series and cause substantial abnormal losses. While these events are disclosed as discrete records through…
Contrastive Learning