paper-with-me

Papers

PICL: Physics Informed Contrastive Learning for Partial Differential Equations

2024-01-29 · Cooper Lorsung, Amir Barati Farimani

Neural operators have recently grown in popularity as Partial Differential Equation (PDE) surrogate models. Learning solution functionals, rather than functions, has proven to be a powerful approach to calculate fast, accurate solutions to complex PDEs. While much work has been done evaluating neural operator performance on a wide variety of surrogate modeling tasks, these works normally evaluate performance on a single equation at a time. In this work, we develop a novel contrastive pretraining framework utilizing Generalized Contrastive Loss that improves neural operator generalization across multiple governing equations simultaneously. Governing equation coefficients are used to measure ground-truth similarity between systems. A combination of physics-informed system evolution and latent-space model output are anchored to input data and used in our distance function. We find that physics-informed contrastive pretraining improves accuracy for the Fourier Neural Operator in fixed-future and autoregressive rollout tasks for the 1D and 2D Heat, Burgers', and linear advection equations.

📄 PDF Abstract BibTeX arXiv:2401.16327

Code (1)

cooplo/picl 공식 구현 pytorch

Tasks

Contrastive Learning

Similar Papers 제목 키워드 기반

Physics Informed RNN-DCT Networks for Time-Dependent Partial Differential Equations

2022-02-24 · Benjamin Wu, Oliver Hennigh, Jan Kautz, Sanjay Choudhry 외

Physics-informed neural networks allow models to be trained by physical laws described by general nonlinear partial differential equations. However, traditional architectures struggle to solve more challenging time-depen…

Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations

2017-11-28 · Maziar Raissi, Paris Perdikaris, George Em. Karniadakis

We introduce physics informed neural networks -- neural networks that are trained to solve supervised learning tasks while respecting any given law of physics described by general nonlinear partial differential equations…

Applications of physics informed neural operators

2022-03-23 · Shawn G. Rosofsky, Hani Al Majed, E. A. Huerta

We present an end-to-end framework to learn partial differential equations that brings together initial data production, selection of boundary conditions, and the use of physics-informed neural operators to solve partial…

Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equations

2017-11-28 · Maziar Raissi, Paris Perdikaris, George Em. Karniadakis

We introduce physics informed neural networks -- neural networks that are trained to solve supervised learning tasks while respecting any given law of physics described by general nonlinear partial differential equations…

Physics Informed Extreme Learning Machine (PIELM) -- A rapid method for the numerical solution of partial differential equations

2019-07-08 · Vikas Dwivedi, Balaji Srinivasan

There has been rapid progress recently on the application of deep networks to the solution of partial differential equations, collectively labelled as Physics Informed Neural Networks (PINNs). In this paper, we develop P…