paper-with-me

홈 › Papers

Tackling the Accuracy-Interpretability Trade-off in a Hierarchy of Machine Learning Models for the Prediction of Extreme Heatwaves

2024-10-01 · Alessandro Lovo, Amaury Lancelin, Corentin Herbert, Freddy Bouchet

When performing predictions that use Machine Learning (ML), we are mainly interested in performance and interpretability. This generates a natural trade-off, where complex models generally have higher skills but are harder to explain and thus trust. Interpretability is particularly important in the climate community, where we aim at gaining a physical understanding of the underlying phenomena. Even more so when the prediction concerns extreme weather events with high impact on society. In this paper, we perform probabilistic forecasts of extreme heatwaves over France, using a hierarchy of increasingly complex ML models, which allows us to find the best compromise between accuracy and interpretability. More precisely, we use models that range from a global Gaussian Approximation (GA) to deep Convolutional Neural Networks (CNNs), with the intermediate steps of a simple Intrinsically Interpretable Neural Network (IINN) and a model using the Scattering Transform (ScatNet). Our findings reveal that CNNs provide higher accuracy, but their black-box nature severely limits interpretability, even when using state-of-the-art Explainable Artificial Intelligence (XAI) tools. In contrast, ScatNet achieves similar performance to CNNs while providing greater transparency, identifying key scales and patterns in the data that drive predictions. This study underscores the potential of interpretability in ML models for climate science, demonstrating that simpler models can rival the performance of their more complex counterparts, all the while being much easier to understand. This gained interpretability is crucial for building trust in model predictions and uncovering new scientific insights, ultimately advancing our understanding and management of extreme weather events.

📄 PDF Abstract BibTeX arXiv:2410.00984

Code (1)

https://zenodo.org/record/13844552 공식 구현

Tasks

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

Methods 이 논문이 사용한 방법론

ScatNet A wavelet scattering transform computes a translation invariant representation, which is stable to deformation, using a deep…

Similar Papers 제목 키워드 기반

Enforcing Interpretability and its Statistical Impacts: Trade-offs between Accuracy and Interpretability

2020-10-26 · Gintare Karolina Dziugaite, Shai Ben-David, Daniel M. Roy

To date, there has been no formal study of the statistical cost of interpretability in machine learning. As such, the discourse around potential trade-offs is often informal and misconceptions abound. In this work, we ai…

Binary ClassificationLearning TheoryMisconceptions

Interpretable Two-level Boolean Rule Learning for Classification

2016-06-18 · Guolong Su, Dennis Wei, Kush R. Varshney, Dmitry M. Malioutov

As a contribution to interpretable machine learning research, we develop a novel optimization framework for learning accurate and sparse two-level Boolean rules. We consider rules in both conjunctive normal form (AND-of-…

BIG-bench Machine LearningClassificationFormGeneral Classification+2

Learning Optimal Fair Classification Trees: Trade-offs Between Interpretability, Fairness, and Accuracy

2022-01-24 · Nathanael Jo, Sina Aghaei, Andrés Gómez, Phebe Vayanos

The increasing use of machine learning in high-stakes domains -- where people's livelihoods are impacted -- creates an urgent need for interpretable, fair, and highly accurate algorithms. With these needs in mind, we pro…

ClassificationFairness

Regularizing Black-box Models for Improved Interpretability (HILL 2019 Version)

2019-05-31 · Gregory Plumb, Maruan Al-Shedivat, Eric Xing, Ameet Talwalkar

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack gua…

BIG-bench Machine LearningInterpretable Machine Learning

Enhancing Recommendation Systems with GNNs and Addressing Over-Smoothing

2024-12-04 · Wenyi Liu, Ziqi Zhang, Xinshi Li, Jiacheng Hu 외

This paper addresses key challenges in enhancing recommendation systems by leveraging Graph Neural Networks (GNNs) and addressing inherent limitations such as over-smoothing, which reduces model effectiveness as network …

Collaborative FilteringExplainable RecommendationRecommendation Systems