Sensitivity of Survival Analysis Metrics
Survival analysis models allow for predicting the probability of an event over time. The specificity of the survival analysis data includes the distribution of events over time and the proportion of classes. Late events are often rare and do not correspond to the main distribution and strongly affect the quality of the models and quality assessment. In this paper, we identify four cases of excessive sensitivity of survival analysis metrics and propose methods to overcome them. To set the equality of observation impacts, we adjust the weights of events based on target time and censoring indicator. According to the sensitivity of metrics, 𝐴𝑈𝑃𝑅𝐶 (area under Precision-Recall curve) is best suited for assessing the quality of survival models, and other metrics are used as loss functions. To evaluate the influence of the loss function, the 𝐵𝑎𝑔𝑔𝑖𝑛𝑔 model uses ones to select the size and hyperparameters of the ensemble. The experimental study included eight real medical datasets. The proposed modifications of 𝐼𝐵𝑆 (Integrated Brier Score) improved the quality of 𝐵𝑎𝑔𝑔𝑖𝑛𝑔 compared to the classical loss functions. In addition, in seven out of eight datasets, the 𝐵𝑎𝑔𝑔𝑖𝑛𝑔 with new loss functions outperforms the existing models of the scikit-survival library.
Code (1)
Tasks
SensitivitySpecificitySurvival AnalysisSimilar Papers 제목 키워드 기반
Stop Chasing the C-index: This Is How We Should Evaluate Our Survival Models
We argue that many survival analysis and time-to-event models are incorrectly evaluated. First, we survey many examples of evaluation approaches in the literature and find that most rely on concordance (C-index). However…
Survival AnalysisFlexible Group Fairness Metrics for Survival Analysis
Algorithmic fairness is an increasingly important field concerned with detecting and mitigating biases in machine learning models. There has been a wealth of literature for algorithmic fairness in regression and classifi…
BIG-bench Machine LearningFairnessPrognosisSurvival AnalysisClustering Survival Data using a Mixture of Non-parametric Experts
Survival analysis aims to predict the timing of future events across various fields, from medical outcomes to customer churn. However, the integration of clustering into survival analysis, particularly for precision medi…
ClusteringSurvival AnalysisFedPseudo: Pseudo value-based Deep Learning Models for Federated Survival Analysis
Survival analysis, time-to-event analysis, is an important problem in healthcare since it has a wide-ranging impact on patients and palliative care. Many survival analysis methods have assumed that the survival data is c…
Federated LearningSurvival AnalysisReinterpreting survival analysis in the universal approximator age
Survival analysis is an integral part of the statistical toolbox. However, while most domains of classical statistics have embraced deep learning, survival analysis only recently gained some minor attention from the deep…
Deep LearningSurvival Analysis