Transformer Based Time-Series Forecasting for Stock

2025-01-29 · Shuozhe Li, Zachery B Schulwol, Risto Miikkulainen

To the naked eye, stock prices are considered chaotic, dynamic, and unpredictable. Indeed, it is one of the most difficult forecasting tasks that hundreds of millions of retail traders and professional traders around the world try to do every second even before the market opens. With recent advances in the development of machine learning and the amount of data the market generated over years, applying machine learning techniques such as deep learning neural networks is unavoidable. In this work, we modeled the task as a multivariate forecasting problem, instead of a naive autoregression problem. The multivariate analysis is done using the attention mechanism via applying a mutated version of the Transformer, "Stockformer", which we created.

📄 PDF Abstract BibTeX arXiv:2502.09625

Code (0)

등록된 구현이 없습니다.

Tasks

Time SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Attention 설명 없음

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Residual Connection 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Multi-Head Attention 설명 없음

Position-Wise Feed-Forward Layer 설명 없음

Transformers with Attentive Federated Aggregation for Time Series Stock Forecasting

2024-01-22 · Chu Myaet Thwal, Ye Lin Tun, Kitae Kim, Seong-Bae Park 외

Recent innovations in transformers have shown their superior performance in natural language processing (NLP) and computer vision (CV). The ability to capture long-range dependencies and interactions in sequential data h…

Decision Making Federated Learning Time Series Time Series Forecasting

Hidformer: Transformer-Style Neural Network in Stock Price Forecasting

2024-12-27 · Kamil Ł. Szydłowski, Jarosław A. Chudziak

This paper investigates the application of Transformer-based neural networks to stock price forecasting, with a special focus on the intersection of machine learning techniques and financial market analysis. The evolutio…

Algorithmic Trading Decision Making Prediction Stock Price Prediction+4

Financial Time Series Forecasting using CNN and Transformer

2023-04-11 · Zhen Zeng, Rachneet Kaur, Suchetha Siddagangappa, Saba Rahimi 외

Time series forecasting is important across various domains for decision-making. In particular, financial time series such as stock prices can be hard to predict as it is difficult to model short-term and long-term tempo…

Decision Making Time Series Time Series Forecasting

Bridging Short- and Long-Term Dependencies: A CNN-Transformer Hybrid for Financial Time Series Forecasting

2025-04-27 · Tiantian Tu

Time series forecasting is crucial for decision-making across various domains, particularly in financial markets where stock prices exhibit complex and non-linear behaviors. Accurately predicting future price movements i…

Decision Making Time Series Time Series Forecasting

A Neuro-Fuzzy System for Interpretable Long-Term Stock Market Forecasting

2025-10-01 · Miha Ožbot, Igor Škrjanc, Vitomir Štruc arxiv

In the complex landscape of multivariate time series forecasting, achieving both accuracy and interpretability remains a significant challenge. This paper introduces the Fuzzy Transformer (Fuzzformer), a novel recurrent …

Multivariate Time Series Forecasting