paper-with-me

홈 › Papers

Excluding the Target Domain Improves Extrapolation: Deconfounded Hierarchical Physics Constraints

2026-05-08 · Tsuyoshi Okita arxiv

Extrapolation to out-of-distribution conditions is a fundamental challenge for physics-constrained deep generative models. Existing methods apply physical constraints as a single static regularization term uniformly across the generation process, and address neither the hierarchical structure of physical laws and the confounding variable problem. We propose the Deconfounded Hierarchical Gate (DHG), which serves as a diagnostic and control mechanism: it identifies when and how strongly temperature confounding contaminates each constraint level, so that hierarchical gates reflect intrinsic physical inconsistency rather than spurious temperature effects. DHG combines counterfactual estimation via the do-operator with backdoor adjustment to remove confounding, then applies Coarse-to-Fine physical constraints progressively. We report a counter-intuitive finding in pretraining: excluding the target-domain data from pretraining outperforms including it by 39% in extrapolation performance (RMSE 0.224 vs. 0.324). This occurs because FNO learns domain-agnostic physical patterns that transfer more effectively when the target domain is withheld. On a lithium-ion battery temperature extrapolation benchmark (trained at 24 degrees Celsius, evaluated at 4.0--43.0 degrees Celsius), our method achieves RMSE = 0.215, a 46% improvement over the unconstrained baseline (Pure CFM: 0.397).

📄 PDF Abstract BibTeX arXiv:2605.07485

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Deconfounded Visual Grounding

2021-12-31 · Jianqiang Huang, Yu Qin, Jiaxin Qi, Qianru Sun 외

We focus on the confounding bias between language and location in the visual grounding pipeline, where we find that the bias is the major visual reasoning bottleneck. For example, the grounding process is usually a trivi…

Referring ExpressionVisual GroundingVisual Reasoning

The Deconfounded Recommender: A Causal Inference Approach to Recommendation

2018-08-20 · Yixin Wang, Dawen Liang, Laurent Charlin, David M. Blei

The goal of recommendation is to show users items that they will like. Though usually framed as a prediction, the spirit of recommendation is to answer an interventional question---for each user and movie, what would the…

Causal InferenceRecommendation Systems

Spectrally Deconfounded Gradient Boosting

2026-07-10 · Andrea Nava, Peter Bühlmann, Fabio Sigrist arxiv

Flexible machine-learning methods can be sensitive to hidden confounding: they may learn associations induced by unobserved confounders rather than stable signals. Spectral deconfounding mitigates this problem by shrinki…

Deconfounded and Explainable Interactive Vision-Language Retrieval of Complex Scenes

2021-10-17 · the 29th ACM International Conference on Multimedia 2021 10 · Junda Wu, Tong Yu, Shuai Li

In vision-language retrieval systems, users provide natural language feedback to find target images. Vision-language explanations in the systems can better guide users to provide feedback and thus improve the retrieval. …

Explainable ModelsLanguage ModellingRetrieval

DeVLBert: Learning Deconfounded Visio-Linguistic Representations

2020-08-16 · Shengyu Zhang, Tan Jiang, Tan Wang, Kun Kuang 외

In this paper, we propose to investigate the problem of out-of-domain visio-linguistic pretraining, where the pretraining data distribution differs from that of downstream data on which the pretrained model will be fine-…

Image RetrievalQuestion AnsweringRetrievalVisual Question Answering+1