paper-with-me

홈 › Papers

Diagnosing Failure Modes of Neural Operators Across Diverse PDE Families

2026-01-16 · Lennon Shikhman arxiv

Neural PDE solvers are increasingly used as learned surrogates for families of partial differential equations, where the key machine learning challenge is not only interpolation on a fixed benchmark distribution but generalization under structured shifts in coefficients, boundary conditions, discretization, and rollout horizon. Yet evaluation is still often dominated by in-distribution test error, making robustness difficult to assess. We introduce a standardized stress-testing framework for neural PDE solvers under deployment-relevant shift. We instantiate it on three representative architectures -- Fourier Neural Operators (FNOs), a DeepONet-style model, and convolutional neural operators (CNOs) -- across five qualitatively different PDE families: dispersive, elliptic, multi-scale fluid, financial, and chaotic systems. Across 750 trained models, we measure robustness using baseline-normalized degradation factors together with spectral and rollout diagnostics. The resulting comparisons reveal that strong in-distribution accuracy does not reliably predict robustness, and that failure patterns depend jointly on architecture and PDE family. Our results provide a clearer basis for evaluating robustness claims in neural PDE solvers and suggest that function-space generalization under structured shift should be treated as a first-class evaluation target.

📄 PDF Abstract BibTeX arXiv:2601.11428

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MTAVG-Bench 2.0: Diagnosing Failure Modes of Cinematic Expressiveness in Multi-Talker Audio-Video Generation

2026-05-27 · Haitian Li, Yanghao Zhou, Heyan Huang, Liangji Chen 외 arxiv

In recent years, Multi-Talker Audio-Video Generation (MTAVG) models have shown promising performance on fundamental metrics such as lip-sync and audio-visual alignment. However, these metrics remain insufficient for asse…

Video Generation

CausalT5k: Diagnosing Refusal and Failure Modes in Trustworthy Causal Reasoning Across Causal Rungs

2026-02-09 · Longling Geng, Andy Ouyang, Theodore Wu, Daphne Barretto 외 arxiv

Large language models increasingly produce fluent causal explanations, yet they often fail in ways aggregate accuracy cannot diagnose: confusing association with intervention, abandoning correct judgments under pressure,…

Diagnosing Failure Modes of Shared-State Collaboration in Resource-Constrained Visual Agents

2026-05-29 · Yunpeng Zhou arxiv

Modular visual reasoning systems increasingly rely on shared working memory for multi-step collaboration, yet the failure dynamics of intermediate state evolution in low-capacity regimes remain underexplored. We study fa…

Visual Question AnsweringVisual Reasoning

Agentic Confidence Calibration

2026-01-22 · Jiaxin Zhang, Caiming Xiong, Chien-Sheng Wu arxiv

AI agents are rapidly advancing from passive language models to autonomous systems executing complex, multi-step tasks. Yet their overconfidence in failure remains a fundamental barrier to deployment in high-stakes setti…

Diagnosing Generalization Failures in Fine-Tuned LLMs: A Cross-Architectural Study on Phishing Detection

2026-01-15 · Frank Bobe, Gregory D. Vetaw, Chase Pavlick, Darshan Bryner 외 arxiv

The practice of fine-tuning Large Language Models (LLMs) has achieved state-of-the-art performance on specialized tasks, yet diagnosing why these models become brittle and fail to generalize remains a critical open probl…