paper-with-me

홈 › Papers

Disentangled Representation Learning for Parametric Partial Differential Equations

2024-10-03 · Ning Liu, Lu Zhang, Tian Gao, Yue Yu

Neural operators (NOs) have demonstrated remarkable success in learning mappings between function spaces, serving as efficient approximators for the forward solutions of complex physical systems governed by partial differential equations (PDEs). However, while effective as black-box solvers, they offer limited insight into the underlying physical mechanism, due to the lack of interpretable representations of the physical parameters that drive the system. To tackle this challenge, we propose a new paradigm for learning disentangled representations from neural operator parameters, thereby effectively solving an inverse problem. Specifically, we introduce DisentangO, a novel hyper-neural operator architecture designed to unveil and disentangle the latent physical factors of variation embedded within the black-box neural operator parameters. At the core of DisentangO is a multi-task neural operator architecture that distills the varying parameters of the governing PDE through a task-wise adaptive layer, coupled with a hierarchical variational autoencoder that disentangles these variations into identifiable latent factors. By learning these disentangled representations, our model not only enhances physical interpretability but also enables more robust generalization across diverse physical systems. Empirical evaluations across supervised, semi-supervised, and unsupervised learning contexts show that DisentangO effectively extracts meaningful and interpretable latent features, bridging the divide between predictive performance and physical understanding in neural operator frameworks.

📄 PDF Abstract BibTeX arXiv:2410.02136

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Single-shot prediction of parametric partial differential equations

2025-05-14 · Khalid Rafiq, Wenjing Liao, Aditya G. Nair

We introduce Flexi-VAE, a data-driven framework for efficient single-shot forecasting of nonlinear parametric partial differential equations (PDEs), eliminating the need for iterative time-stepping while maintaining high…

CPUGPUPrediction

Meta-learning Loss Functions of Parametric Partial Differential Equations Using Physics-Informed Neural Networks

2024-11-29 · Michail Koumpanakis, Ricardo Vilalta

This paper proposes a new way to learn Physics-Informed Neural Network loss functions using Generalized Additive Models. We apply our method by meta-learning parametric partial differential equations, PDEs, on Burger's a…

Additive modelsMeta-Learning

A Theoretical Analysis of Deep Neural Networks and Parametric PDEs

2019-03-31 · Gitta Kutyniok, Philipp Petersen, Mones Raslan, Reinhold Schneider

We derive upper bounds on the complexity of ReLU neural networks approximating the solution maps of parametric partial differential equations. In particular, without any knowledge of its concrete shape, we use the inhere…

PDE-Driven Spatiotemporal Disentanglement

2020-08-04 · ICLR 2021 1 · Jérémie Donà, Jean-Yves Franceschi, Sylvain Lamprier, Patrick Gallinari

A recent line of work in the machine learning community addresses the problem of predicting high-dimensional spatiotemporal phenomena by leveraging specific tools from the differential equations theory. Following this di…

Disentanglement

Dual parametric and state estimation for partial differential equations

2023-12-19 · Saviz Mowlavi, Mouhacine Benosman

Designing estimation algorithms for systems governed by partial differential equations (PDEs) such as fluid flows is challenging due to the high-dimensional and oftentimes nonlinear nature of the dynamics, as well as the…

State Estimation