paper-with-me

Papers

Discovering material information using hierarchical Reformer model on financial regulatory filings

2022-03-28 · Francois Mercier, Makesh Narsimhan

Most applications of machine learning for finance are related to forecasting tasks for investment decisions. Instead, we aim to promote a better understanding of financial markets with machine learning techniques. Leveraging the tremendous progress in deep learning models for natural language processing, we construct a hierarchical Reformer ([15]) model capable of processing a large document level dataset, SEDAR, from canadian financial regulatory filings. Using this model, we show that it is possible to predict trade volume changes using regulatory filings. We adapt the pretraining task of HiBERT ([36]) to obtain good sentence level representations using a large unlabelled document dataset. Finetuning the model to successfully predict trade volume changes indicates that the model captures a view from financial markets and processing regulatory filings is beneficial. Analyzing the attention patterns of our model reveals that it is able to detect some indications of material information without explicit training, which is highly relevant for investors and also for the market surveillance mandate of financial regulators.

📄 PDF Abstract BibTeX arXiv:2204.05979

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningSentence

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Multi-Head Attention 설명 없음
SentencePiece 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Mamba Outpaces Reformer in Stock Prediction with Sentiments from Top Ten LLMs

2025-09-14 · Lokesh Antony Kadiyala, Amir Mirzaeinia arxiv

The stock market is extremely difficult to predict in the short term due to high market volatility, changes caused by news, and the non-linear nature of the financial time series. This research proposes a novel framework…

Sentiment Analysis

RestoreFormer: High-Quality Blind Face Restoration from Undegraded Key-Value Pairs

2022-01-17 · CVPR 2022 1 · Zhouxia Wang, Jiawei Zhang, Runjian Chen, Wenping Wang 외

Blind face restoration is to recover a high-quality face image from unknown degradations. As face image contains abundant contextual information, we propose a method, RestoreFormer, which explores fully-spatial attention…

Blind Face RestorationFace ReconstructionVocal Bursts Intensity Prediction

Event-based Monocular Dense Depth Estimation with Recurrent Transformers

2022-12-06 · Xu Liu, Jianing Li, Xiaopeng Fan, Yonghong Tian

Event cameras, offering high temporal resolutions and high dynamic ranges, have brought a new perspective to address common challenges (e.g., motion blur and low light) in monocular depth estimation. However, how to effe…

DecoderDepth EstimationEvent-based visionGPU+1

RestoreFormer++: Towards Real-World Blind Face Restoration from Undegraded Key-Value Pairs

2023-08-14 · Zhouxia Wang, Jiawei Zhang, Tianshui Chen, Wenping Wang 외

Blind face restoration aims at recovering high-quality face images from those with unknown degradations. Current algorithms mainly introduce priors to complement high-quality details and achieve impressive progress. Howe…

Blind Face Restoration

Efficient Symmetry-Aware Materials Generation via Hierarchical Generative Flow Networks

2024-11-06 · Tri Minh Nguyen, Sherif Abdulkader Tawfik, Truyen Tran, Sunil Gupta 외

Discovering new solid-state materials requires rapidly exploring the vast space of crystal structures and locating stable regions. Generating stable materials with desired properties and compositions is extremely difficu…

Diversity