paper-with-me

Papers

Multi-task Envisioning Transformer-based Autoencoder for Corporate Credit Rating Migration Early Prediction

2022-07-10 · Han Yue, Steve Xia, Hongfu Liu

Corporate credit ratings issued by third-party rating agencies are quantified assessments of a company's creditworthiness. Credit Ratings highly correlate to the likelihood of a company defaulting on its debt obligations. These ratings play critical roles in investment decision-making as one of the key risk factors. They are also central to the regulatory framework such as BASEL II in calculating necessary capital for financial institutions. Being able to predict rating changes will greatly benefit both investors and regulators alike. In this paper, we consider the corporate credit rating migration early prediction problem, which predicts the credit rating of an issuer will be upgraded, unchanged, or downgraded after 12 months based on its latest financial reporting information at the time. We investigate the effectiveness of different standard machine learning algorithms and conclude these models deliver inferior performance. As part of our contribution, we propose a new Multi-task Envisioning Transformer-based Autoencoder (META) model to tackle this challenging problem. META consists of Positional Encoding, Transformer-based Autoencoder, and Multi-task Prediction to learn effective representations for both migration prediction and rating prediction. This enables META to better explore the historical data in the training stage for one-year later prediction. Experimental results show that META outperforms all baseline models.

📄 PDF Abstract BibTeX arXiv:2207.04539

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingPrediction

Similar Papers 제목 키워드 기반

Multimodal Transformer for Parallel Concatenated Variational Autoencoders

2022-10-28 · Stephen D. Liang, Jerry M. Mendel

In this paper, we propose a multimodal transformer using parallel concatenated architecture. Instead of using patches, we use column stripes for images in R, G, B channels as the transformer input. The column stripes kee…

Decoder

Re-envisioning Euclid Galaxy Morphology: Identifying and Interpreting Features with Sparse Autoencoders

2025-10-27 · John F. Wu, Michael Walmsley arxiv

Sparse Autoencoders (SAEs) can efficiently identify candidate monosemantic features from pretrained neural networks for galaxy morphology. We demonstrate this on Euclid Q1 images using both supervised (Zoobot) and new se…

Image Reconstruction

Novelty Detection and Analysis of Traffic Scenario Infrastructures in the Latent Space of a Vision Transformer-Based Triplet Autoencoder

2021-05-05 · Jonas Wurst, Lakshman Balasubramanian, Michael Botsch, Wolfgang Utschick

Detecting unknown and untested scenarios is crucial for scenario-based testing. Scenario-based testing is considered to be a possible approach to validate autonomous vehicles. A traffic scenario consists of multiple comp…

Autonomous VehiclesNovelty DetectionOutlier DetectionTriplet

Envisioning National Resources for Artificial Intelligence Research: NSF Workshop Report

2024-12-13 · Shantenu Jha, Yolanda Gil

This is a report of an NSF workshop titled "Envisioning National Resources for Artificial Intelligence Research" held in Alexandria, Virginia, in May 2024. The workshop aimed to identify initial challenges and opportunit…

Finetuning Pretrained Transformers into Variational Autoencoders

2021-08-05 · EMNLP (insights) 2021 11 · Seongmin Park, Jihwa Lee

Text variational autoencoders (VAEs) are notorious for posterior collapse, a phenomenon where the model's decoder learns to ignore signals from the encoder. Because posterior collapse is known to be exacerbated by expres…

DecoderLanguage ModelingLanguage Modelling