paper-with-me

홈 › Papers

Efficient Generative Transformer Operators For Million-Point PDEs

2025-12-04 · Armand Kassaï Koupaï, Lise Le Boudec, Patrick Gallinari arxiv

We introduce ECHO, a transformer-operator framework for generating million-point PDE trajectories. While existing neural operators (NOs) have shown promise for solving partial differential equations, they remain limited in practice due to poor scalability on dense grids, error accumulation during dynamic unrolling, and task-specific design. ECHO addresses these challenges through three key innovations. (i) It employs a hierarchical convolutional encode-decode architecture that achieves a 100 $\times$ spatio-temporal compression while preserving fidelity on mesh points. (ii) It incorporates a training and adaptation strategy that enables high-resolution PDE solution generation from sparse input grids. (iii) It adopts a generative modeling paradigm that learns complete trajectory segments, mitigating long-horizon error drift. The training strategy decouples representation learning from downstream task supervision, allowing the model to tackle multiple tasks such as trajectory generation, forward and inverse problems, and interpolation. The generative model further supports both conditional and unconditional generation. We demonstrate state-of-the-art performance on million-point simulations across diverse PDE systems featuring complex geometries, high-frequency dynamics, and long-term horizons.

📄 PDF Abstract BibTeX arXiv:2512.04974

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

CATO: Charted Attention for Neural PDE Operators

2026-05-09 · Chun-Wun Cheng, Sifan Wang, Carola-Bibiane Schönlieb, Angelica I. Aviles-Rivero arxiv

Neural operators have emerged as powerful data-driven solvers for PDEs, offering substantial acceleration over classical numerical methods. However, existing transformer-based operators still face critical challenges whe…

Mamba Neural Operator: Who Wins? Transformers vs. State-Space Models for PDEs

2024-10-03 · Chun-Wun Cheng, Jiahao Huang, Yi Zhang, Guang Yang 외

Partial differential equations (PDEs) are widely used to model complex physical systems, but solving them efficiently remains a significant challenge. Recently, Transformers have emerged as the preferred architecture for…

MambaState Space Models

BENO: Boundary-embedded Neural Operators for Elliptic PDEs

2024-01-17 · Haixin Wang, Jiaxin Li, Anubhav Dwivedi, Kentaro Hara 외

Elliptic partial differential equations (PDEs) are a major class of time-independent PDEs that play a key role in many scientific and engineering domains such as fluid dynamics, plasma physics, and solid mechanics. Recen…

Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometries

2025-02-04 · Huakun Luo, Haixu Wu, Hang Zhou, Lanxiang Xing 외

Although deep models have been widely explored in solving partial differential equations (PDEs), previous works are primarily limited to data only with up to tens of thousands of mesh points, far from the million-point s…

GPU

Mondrian: Transformer Operators via Domain Decomposition

2025-06-09 · Arthur Feeney, Kuei-Hsiang Huang, Aparna Chandramowlishwaran

Operator learning enables data-driven modeling of partial differential equations (PDEs) by learning mappings between function spaces. However, scaling transformer-based operator models to high-resolution, multiscale doma…

Operator learning