Discovering material information using hierarchical Reformer model on financial regulatory filings
Most applications of machine learning for finance are related to forecasting tasks for investment decisions. Instead, we aim to promote a better understanding of financial markets with machine learning techniques. Leveraging the tremendous progress in deep learning models for natural language processing, we construct a hierarchical Reformer ([15]) model capable of processing a large document level dataset, SEDAR, from canadian financial regulatory filings. Using this model, we show that it is possible to predict trade volume changes using regulatory filings. We adapt the pretraining task of HiBERT ([36]) to obtain good sentence level representations using a large unlabelled document dataset. Finetuning the model to successfully predict trade volume changes indicates that the model captures a view from financial markets and processing regulatory filings is beneficial. Analyzing the attention patterns of our model reveals that it is able to detect some indications of material information without explicit training, which is highly relevant for investors and also for the market surveillance mandate of financial regulators.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Mamba Outpaces Reformer in Stock Prediction with Sentiments from Top Ten LLMs
The stock market is extremely difficult to predict in the short term due to high market volatility, changes caused by news, and the non-linear nature of the financial time series. This research proposes a novel framework…
Sentiment AnalysisRestoreFormer: High-Quality Blind Face Restoration from Undegraded Key-Value Pairs
Blind face restoration is to recover a high-quality face image from unknown degradations. As face image contains abundant contextual information, we propose a method, RestoreFormer, which explores fully-spatial attention…
Blind Face RestorationFace ReconstructionVocal Bursts Intensity PredictionEvent-based Monocular Dense Depth Estimation with Recurrent Transformers
Event cameras, offering high temporal resolutions and high dynamic ranges, have brought a new perspective to address common challenges (e.g., motion blur and low light) in monocular depth estimation. However, how to effe…
DecoderDepth EstimationEvent-based visionGPU+1RestoreFormer++: Towards Real-World Blind Face Restoration from Undegraded Key-Value Pairs
Blind face restoration aims at recovering high-quality face images from those with unknown degradations. Current algorithms mainly introduce priors to complement high-quality details and achieve impressive progress. Howe…
Blind Face RestorationEfficient Symmetry-Aware Materials Generation via Hierarchical Generative Flow Networks
Discovering new solid-state materials requires rapidly exploring the vast space of crystal structures and locating stable regions. Generating stable materials with desired properties and compositions is extremely difficu…
Diversity