paper-with-me

Papers

Guided Diffusion Sampling on Function Spaces with Applications to PDEs

2025-05-22 · Jiachen Yao, Abbas Mammadov, Julius Berner, Gavin Kerrigan, Jong Chul Ye, Kamyar Azizzadenesheli, Anima Anandkumar

We propose a general framework for conditional sampling in PDE-based inverse problems, targeting the recovery of whole solutions from extremely sparse or noisy measurements. This is accomplished by a function-space diffusion model and plug-and-play guidance for conditioning. Our method first trains an unconditional discretization-agnostic denoising model using neural operator architectures. At inference, we refine the samples to satisfy sparse observation data via a gradient-based guidance mechanism. Through rigorous mathematical analysis, we extend Tweedie's formula to infinite-dimensional Hilbert spaces, providing the theoretical foundation for our posterior sampling approach. Our method (FunDPS) accurately captures posterior distributions in function spaces under minimal supervision and severe data scarcity. Across five PDE tasks with only 3% observation, our method achieves an average 32% accuracy improvement over state-of-the-art fixed-resolution diffusion baselines while reducing sampling steps by 4x. Furthermore, multi-resolution fine-tuning ensures strong cross-resolution generalizability. To the best of our knowledge, this is the first diffusion-based framework to operate independently of discretization, offering a practical and flexible solution for forward and inverse problems in the context of PDEs. Code is available at https://github.com/neuraloperator/FunDPS

📄 PDF Abstract BibTeX arXiv:2505.17004

Code (1)

neuraloperator/fundps 공식 구현 pytorch

Tasks

Denoising

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Unlocking Guidance for Discrete State-Space Diffusion and Flow Models

2024-06-03 · Hunter Nisonoff, Junhao Xiong, Stephan Allenspach, Jennifer Listgarten

Generative models on discrete state-spaces have a wide range of potential applications, particularly in the domain of natural sciences. In continuous state-spaces, controllable and flexible generation of samples with des…

State Space Models

Split Gibbs Discrete Diffusion Posterior Sampling

2025-03-03 · Wenda Chu, Yang song, Yisong Yue

We study the problem of posterior sampling in discrete-state spaces using discrete diffusion models. While posterior sampling methods for continuous diffusion models have achieved remarkable progress, analogous methods f…

Stochastic Optimal Control for Diffusion Bridges in Function Spaces

2024-05-31 · Byoungwoo Park, JungWon Choi, Sungbin Lim, Juho Lee

Recent advancements in diffusion models and diffusion bridges primarily focus on finite-dimensional spaces, yet many real-world problems necessitate operations in infinite-dimensional function spaces for more natural and…

Image-to-Image TranslationTime Series

Functional Adjoint Sampler: Scalable Sampling on Infinite Dimensional Spaces

2025-11-09 · Byoungwoo Park, Juho Lee, Guan-Horng Liu arxiv

Learning-based methods for sampling from the Gibbs distribution in finite-dimensional spaces have progressed quickly, yet theory and algorithmic design for infinite-dimensional function spaces remain limited. This gap pe…

Consistency Posterior Sampling for Diverse Image Synthesis

2025-01-01 · CVPR 2025 1 · Vishal Purohit, Matthew Repasky, Jianfeng Lu, Qiang Qiu 외

Posterior sampling in high-dimensional spaces using generative models holds significant promise for various applications, including but not limited to inverse problems and guided generation tasks. Generating diverse …

Image GenerationImage Restoration