paper-with-me

홈 › Papers

Distilling Machine Learning's Added Value: Pareto Fronts in Atmospheric Applications

2024-08-04 · Tom Beucler, Arthur Grundner, Sara Shamekh, Peter Ukkonen, Matthew Chantry, Ryan Lagerquist

The added value of machine learning for weather and climate applications is measurable through performance metrics, but explaining it remains challenging, particularly for large deep learning models. Inspired by climate model hierarchies, we propose that a full hierarchy of Pareto-optimal models, defined within an appropriately determined error-complexity plane, can guide model development and help understand the models' added value. We demonstrate the use of Pareto fronts in atmospheric physics through three sample applications, with hierarchies ranging from semi-empirical models with minimal parameters to deep learning algorithms. First, in cloud cover parameterization, we find that neural networks identify nonlinear relationships between cloud cover and its thermodynamic environment, and assimilate previously neglected features such as vertical gradients in relative humidity that improve the representation of low cloud cover. This added value is condensed into a ten-parameter equation that rivals deep learning models. Second, we establish a machine learning model hierarchy for emulating shortwave radiative transfer, distilling the importance of bidirectional vertical connectivity for accurately representing absorption and scattering, especially for multiple cloud layers. Third, we emphasize the importance of convective organization information when modeling the relationship between tropical precipitation and its surrounding environment. We discuss the added value of temporal memory when high-resolution spatial information is unavailable, with implications for precipitation parameterization. Therefore, by comparing data-driven models directly with existing schemes using Pareto optimality, we promote process understanding by hierarchically unveiling system complexity, with the hope of improving the trustworthiness of machine learning models in atmospheric applications.

📄 PDF Abstract BibTeX arXiv:2408.02161

Code (1)

tbeucler/2024_pareto_distillation 공식 구현

Tasks

Deep Learning

Similar Papers 제목 키워드 기반

Multi-Objective Learning to Predict Pareto Fronts Using Hypervolume Maximization

2021-02-08 · Timo M. Deist, Monika Grewal, Frank J. W. M. Dankers, Tanja Alderliesten 외

Real-world problems are often multi-objective with decision-makers unable to specify a priori which trade-off between the conflicting objectives is preferable. Intuitively, building machine learning solutions in such cas…

Hypervolume-Optimal $μ$-Distributions on Line/Plane-based Pareto Fronts in Three Dimensions

2021-04-20 · Ke Shang, Hisao Ishibuchi, WeiYu Chen, Yang Nan 외

Hypervolume is widely used in the evolutionary multi-objective optimization (EMO) field to evaluate the quality of a solution set. For a solution set with $\mu$ solutions on a Pareto front, a larger hypervolume means a b…

Simple Problems: The Simplicial Gluing Structure of Pareto Sets and Pareto Fronts

2017-04-18 · Naoki Hamada

Quite a few studies on real-world applications of multi-objective optimization reported that their Pareto sets and Pareto fronts form a topological simplex. Such a class of problems was recently named the simple problems…

Data-Driven Preference Sampling for Pareto Front Learning

2024-04-12 · Rongguang Ye, Lei Chen, Weiduo Liao, Jinyuan Zhang 외

Pareto front learning is a technique that introduces preference vectors in a neural network to approximate the Pareto front. Previous Pareto front learning methods have demonstrated high performance in approximating simp…

Accuracy and Fairness Trade-offs in Machine Learning: A Stochastic Multi-Objective Approach

2020-08-03 · Suyun Liu, Luis Nunes Vicente

In the application of machine learning to real-life decision-making systems, e.g., credit scoring and criminal justice, the prediction outcomes might discriminate against people with sensitive attributes, leading to unfa…

BIG-bench Machine LearningDecision MakingFairness