Particle-Filtering-based Latent Diffusion for Inverse Problems
Current strategies for solving image-based inverse problems apply latent diffusion models to perform posterior sampling.However, almost all approaches make no explicit attempt to explore the solution space, instead drawing only a single sample from a Gaussian distribution from which to generate their solution. In this paper, we introduce a particle-filtering-based framework for a nonlinear exploration of the solution space in the initial stages of reverse SDE methods. Our proposed particle-filtering-based latent diffusion (PFLD) method and proposed problem formulation and framework can be applied to any diffusion-based solution for linear or nonlinear inverse problems. Our experimental results show that PFLD outperforms the SoTA solver PSLD on the FFHQ-1K and ImageNet-1K datasets on inverse problem tasks of super resolution, Gaussian debluring and inpainting.
Code (0)
등록된 구현이 없습니다.
Tasks
Super-ResolutionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Repulsive Latent Score Distillation for Solving Inverse Problems
Score Distillation Sampling (SDS) has been pivotal for leveraging pre-trained diffusion models in downstream tasks such as inverse problems, but it faces two major challenges: $(i)$ mode collapse and $(ii)$ latent space …
Computational EfficiencyDiversityImage GenerationText-to-Image GenerationWhen is Particle Filtering Efficient for Planning in Partially Observed Linear Dynamical Systems?
Particle filtering is a popular method for inferring latent states in stochastic dynamical systems, whose theoretical properties have been well studied in machine learning and statistics communities. In many control prob…
Decision MakingSequential Decision MakingEnd-To-End Latent Variational Diffusion Models for Inverse Problems in High Energy Physics
High-energy collisions at the Large Hadron Collider (LHC) provide valuable insights into open questions in particle physics. However, detector effects must be corrected before measurements can be compared to certain theo…
Constrained Particle Seeking: Solving Diffusion Inverse Problems with Just Forward Passes
Diffusion models have gained prominence as powerful generative tools for solving inverse problems due to their ability to model complex data distributions. However, existing methods typically rely on complete knowledge o…
CbLDM: A Diffusion Model for recovering nanostructure from atomic pair distribution function
The nanostructure inverse problem is an attractive problem that helps researchers to understand the relationship between the properties and the structure of nanomaterials. This study focuses on the problem of recovering …