paper-with-me

Papers

HAMLET: Graph Transformer Neural Operator for Partial Differential Equations

2024-02-05 · Andrey Bryutkin, Jiahao Huang, Zhongying Deng, Guang Yang, Carola-Bibiane Schönlieb, Angelica Aviles-Rivero

We present a novel graph transformer framework, HAMLET, designed to address the challenges in solving partial differential equations (PDEs) using neural networks. The framework uses graph transformers with modular input encoders to directly incorporate differential equation information into the solution process. This modularity enhances parameter correspondence control, making HAMLET adaptable to PDEs of arbitrary geometries and varied input formats. Notably, HAMLET scales effectively with increasing data complexity and noise, showcasing its robustness. HAMLET is not just tailored to a single type of physical simulation, but can be applied across various domains. Moreover, it boosts model resilience and performance, especially in scenarios with limited data. We demonstrate, through extensive experiments, that our framework is capable of outperforming current techniques for PDEs.

📄 PDF Abstract BibTeX arXiv:2402.03541

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

GITO: Graph-Informed Transformer Operator for Learning Complex Partial Differential Equations

2025-06-16 · Milad Ramezankhani, Janak M. Patel, Anirudh Deodhar, Dagnachew Birru

We present a novel graph-informed transformer operator (GITO) architecture for learning complex partial differential equation systems defined on irregular geometries and non-uniform meshes. GITO consists of two main modu…

Graph Neural NetworkSuper-Resolution

Transformer for Partial Differential Equations' Operator Learning

2022-05-26 · Zijie Li, Kazem Meidani, Amir Barati Farimani

Data-driven learning of partial differential equations' solution operators has recently emerged as a promising paradigm for approximating the underlying solutions. The solution operators are usually parameterized by deep…

Graph Neural NetworkOperator learning

Physics Informed Token Transformer for Solving Partial Differential Equations

2023-05-15 · Cooper Lorsung, Zijie Li, Amir Barati Farimani

Solving Partial Differential Equations (PDEs) is the core of many fields of science and engineering. While classical approaches are often prohibitively slow, machine learning models often fail to incorporate complete sys…

GeoMaNO: Geometric Mamba Neural Operator for Partial Differential Equations

2025-05-17 · Xi Han, Jingwei Zhang, Dimitris Samaras, Fei Hou 외

The neural operator (NO) framework has emerged as a powerful tool for solving partial differential equations (PDEs). Recent NOs are dominated by the Transformer architecture, which offers NOs the capability to capture lo…

Mamba

Multi-scale Time-stepping of Partial Differential Equations with Transformers

2023-11-03 · AmirPouya Hemmasian, Amir Barati Farimani

Developing fast surrogates for Partial Differential Equations (PDEs) will accelerate design and optimization in almost all scientific and engineering applications. Neural networks have been receiving ever-increasing atte…