paper-with-me

홈 › Papers

Enhancing Risk Assessment in Transformers with Loss-at-Risk Functions

2024-11-04 · Jinghan Zhang, Henry Xie, Xinhao Zhang, Kunpeng Liu

In the financial field, precise risk assessment tools are essential for decision-making. Recent studies have challenged the notion that traditional network loss functions like Mean Square Error (MSE) are adequate, especially under extreme risk conditions that can lead to significant losses during market upheavals. Transformers and Transformer-based models are now widely used in financial forecasting according to their outstanding performance in time-series-related predictions. However, these models typically lack sensitivity to extreme risks and often underestimate great financial losses. To address this problem, we introduce a novel loss function, the Loss-at-Risk, which incorporates Value at Risk (VaR) and Conditional Value at Risk (CVaR) into Transformer models. This integration allows Transformer models to recognize potential extreme losses and further improves their capability to handle high-stakes financial decisions. Moreover, we conduct a series of experiments with highly volatile financial datasets to demonstrate that our Loss-at-Risk function improves the Transformers' risk prediction and management capabilities without compromising their decision-making accuracy or efficiency. The results demonstrate that integrating risk-aware metrics during training enhances the Transformers' risk assessment capabilities while preserving their core strengths in decision-making and reasoning across diverse scenarios.

📄 PDF Abstract BibTeX arXiv:2411.02558

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Attention 설명 없음
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Managing Basis Risks in Weather Parametric Insurance: A Quantitative Study of Diversification and Key Influencing Factors

2024-09-25 · Hang Gao, Shuohua Yang, Xinli Liu

Weather parametric insurance relies on weather indices rather than actual loss assessments, enhancing claims efficiency, reducing moral hazard, and improving fairness. In the context of increasing climate change risks, d…

Fairness

Borrowing From the Future: Enhancing Early Risk Assessment through Contrastive Learning

2025-08-15 · Minghui Sun, Matthew M. Engelhard, Benjamin A. Goldstein arxiv

Risk assessments for a pediatric population are often conducted across multiple stages. For example, clinicians may evaluate risks prenatally, at birth, and during Well-Child visits. Although predictions made at later st…

Contrastive Learning

Just-In-Time Learning for Operational Risk Assessment in Power Grids

2022-09-26 · Oliver Stover, Pranav Karve, Sankaran Mahadevan, Wenbo Chen 외

In a grid with a significant share of renewable generation, operators will need additional tools to evaluate the operational risk due to the increased volatility in load and generation. The computational requirements of …

LADRI: LeArning-based Dynamic Risk Indicator in Automated Driving System

2024-01-04 · Anil Ranjitbhai Patel, Peter Liggesmeyer

As the horizon of intelligent transportation expands with the evolution of Automated Driving Systems (ADS), ensuring paramount safety becomes more imperative than ever. Traditional risk assessment methodologies, primaril…

Navigate

Multi-criteria Decision-making of Intelligent Vehicles under Fault Condition Enhancing Public-private Partnership

2022-05-27 · Xin Tao, Mladen Čičić, Jonas Mårtensson

With the development of vehicular technologies on automation, electrification, and digitalization, vehicles are becoming more intelligent while being exposed to more complex, uncertain, and frequently occurring faults. I…

Decision Making