paper-with-me

홈 › Papers

Mitigating distribution shift in machine learning-augmented hybrid simulation

2024-01-17 · Jiaxi Zhao, Qianxiao Li

We study the problem of distribution shift generally arising in machine-learning augmented hybrid simulation, where parts of simulation algorithms are replaced by data-driven surrogates. We first establish a mathematical framework to understand the structure of machine-learning augmented hybrid simulation problems, and the cause and effect of the associated distribution shift. We show correlations between distribution shift and simulation error both numerically and theoretically. Then, we propose a simple methodology based on tangent-space regularized estimator to control the distribution shift, thereby improving the long-term accuracy of the simulation results. In the linear dynamics case, we provide a thorough theoretical analysis to quantify the effectiveness of the proposed method. Moreover, we conduct several numerical experiments, including simulating a partially known reaction-diffusion equation and solving Navier-Stokes equations using the projection method with a data-driven pressure solver. In all cases, we observe marked improvements in simulation accuracy under the proposed method, especially for systems with high degrees of distribution shift, such as those with relatively strong non-linear reaction mechanisms, or flows at large Reynolds numbers.

📄 PDF Abstract BibTeX arXiv:2401.09259

Code (1)

jiaxi98/ml4dynamics 공식 구현 jax

Similar Papers 제목 키워드 기반

Augmented Inverse Hybrid Weighting: Robust Inference under Deterministic and Random Distribution Shifts

2026-08-01 · Ying Jin, Ying Jin, Dominik Rothenhäusler arxiv

Reweighting source samples to match a target covariate distribution is a standard response to distribution shift when generalizing evidence from one population to another. This strategy is well suited to deterministic, l…

SelfAug: Mitigating Catastrophic Forgetting in Retrieval-Augmented Generation via Distribution Self-Alignment

2025-09-04 · Yuqing Huang, Rongyang Zhang, Qimeng Wang, Chengqiang Lu 외 arxiv

Recent advancements in large language models (LLMs) have revolutionized natural language processing through their remarkable capabilities in understanding and executing diverse tasks. While supervised fine-tuning, partic…

Diagnosing failures of fairness transfer across distribution shift in real-world medical settings

2022-02-02 · Jessica Schrouff, Natalie Harris, Oluwasanmi Koyejo, Ibrahim Alabdulmohsin 외

Diagnosing and mitigating changes in model fairness under distribution shift is an important component of the safe deployment of machine learning in healthcare settings. Importantly, the success of any mitigation strateg…

BIG-bench Machine LearningFairness

Sample-Mean Anchored Thompson Sampling for Offline-to-Online Learning with Distribution Shift

2026-05-11 · Bochao Li, Yao Fu, Wei Chen, Fang Kong arxiv

Offline-to-online learning aims to improve online decision-making by leveraging offline logged data. A central challenge in this setting is the distribution shift between offline and online environments. While some exist…

Generalization vs. Specialization under Concept Shift

2024-09-23 · Alex Nguyen, David J. Schwab, Vudtiwat Ngampruetikorn

Machine learning models are often brittle under distribution shift, i.e., when data distributions at test time differ from those during training. Understanding this failure mode is central to identifying and mitigating s…