paper-with-me

홈 › Papers

The value of text for small business default prediction: A deep learning approach

2020-03-19 · Matthew Stevenson, Christophe Mues, Cristián Bravo

Compared to consumer lending, Micro, Small and Medium Enterprise (mSME) credit risk modelling is particularly challenging, as, often, the same sources of information are not available. Therefore, it is standard policy for a loan officer to provide a textual loan assessment to mitigate limited data availability. In turn, this statement is analysed by a credit expert alongside any available standard credit data. In our paper, we exploit recent advances from the field of Deep Learning and Natural Language Processing (NLP), including the BERT (Bidirectional Encoder Representations from Transformers) model, to extract information from 60 000 textual assessments provided by a lender. We consider the performance in terms of the AUC (Area Under the receiver operating characteristic Curve) and Brier Score metrics and find that the text alone is surprisingly effective for predicting default. However, when combined with traditional data, it yields no additional predictive capability, with performance dependent on the text's length. Our proposed deep learning model does, however, appear to be robust to the quality of the text and therefore suitable for partly automating the mSME lending process. We also demonstrate how the content of loan assessments influences performance, leading us to a series of recommendations on a new strategy for collecting future mSME loan assessments.

📄 PDF Abstract BibTeX arXiv:2003.08964

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Deep learning in business analytics and operations research: Models, applications and managerial implications

2018-06-28 · Mathias Kraus, Stefan Feuerriegel, Asil Oztekin

Business analytics refers to methods and practices that create value through data for individuals, firms, and organizations. This field is currently experiencing a radical shift due to the advent of deep learning: deep n…

BIG-bench Machine LearningDeep Learning

Effect of hyperparameters on variable selection in random forests

2023-09-13 · Cesaire J. K. Fouodo, Lea L. Kronziel, Inke R. König, Silke Szymczak

Random forests (RFs) are well suited for prediction modeling and variable selection in high-dimensional omics studies. The effect of hyperparameters of the RF algorithm on prediction performance and variable importance e…

SensitivityVariable Selection

Pricing Transition Risk with a Jump-Diffusion Credit Risk Model: Evidences from the CDS market

2023-03-22 · Giulia Livieri, Davide Radi, Elia Smaniotto

Transition risk can be defined as the business-risk related to the enactment of green policies, aimed at driving the society towards a sustainable and low-carbon economy. In particular, the value of certain firms' assets…

quantile regression

Learning measures of semi-additive behaviour

2015-12-09 · Hamidreza Chinaei, Mohsen Rais-Ghasem, Frank Rudzicz

In business analytics, measure values, such as sales numbers or volumes of cargo transported, are often summed along values of one or more corresponding categories, such as time or shipping container. However, not every …

Unleashing the power of text for credit default prediction: Comparing human-written and generative AI-refined texts

2025-03-23 · Zongxiao Wu, Yizhe Dong, Yaoyiran Li, Baofeng Shi

This study explores the integration of a representative large language model, ChatGPT, into lending decision-making with a focus on credit default prediction. Specifically, we use ChatGPT to analyse and interpret loan as…

Large Language ModelSemantic SimilaritySemantic Textual Similarity