paper-with-me

홈 › Papers

Diffusion priors for Bayesian 3D reconstruction from incomplete measurements

2024-12-19 · Julian L. Möbius, Michael Habeck

Many inverse problems are ill-posed and need to be complemented by prior information that restricts the class of admissible models. Bayesian approaches encode this information as prior distributions that impose generic properties on the model such as sparsity, non-negativity or smoothness. However, in case of complex structured models such as images, graphs or three-dimensional (3D) objects,generic prior distributions tend to favor models that differ largely from those observed in the real world. Here we explore the use of diffusion models as priors that are combined with experimental data within a Bayesian framework. We use 3D point clouds to represent 3D objects such as household items or biomolecular complexes formed from proteins and nucleic acids. We train diffusion models that generate coarse-grained 3D structures at a medium resolution and integrate these with incomplete and noisy experimental data. To demonstrate the power of our approach, we focus on the reconstruction of biomolecular assemblies from cryo-electron microscopy (cryo-EM) images, which is an important inverse problem in structural biology. We find that posterior sampling with diffusion model priors allows for 3D reconstruction from very sparse, low-resolution and partial observations.

📄 PDF Abstract BibTeX arXiv:2412.14897

Code (0)

등록된 구현이 없습니다.

Tasks

3D Reconstruction

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Bayesian Rain Field Reconstruction using Commercial Microwave Links and Diffusion Model Priors

2026-05-06 · Badr Moufad, Albina Ilina, Hai Victor Habi, Salem Lahlou 외 arxiv

Commercial Microwave Links (CMLs) offer dense spatial coverage for rainfall sensing but produce path-integrated measurements that make accurate ground-level reconstruction challenging. Existing methods typically oversimp…

Gaussian Processes

Variational Bayesian Imaging with an Efficient Surrogate Score-based Prior

2023-09-05 · Berthy T. Feng, Katherine L. Bouman

We propose a surrogate function for efficient yet principled use of score-based priors in Bayesian imaging. We consider ill-posed inverse imaging problems in which one aims for a clean image posterior given incomplete or…

Variational Inference

Score-Based Diffusion Models as Principled Priors for Inverse Imaging

2023-04-23 · ICCV 2023 1 · Berthy T. Feng, Jamie Smith, Michael Rubinstein, Huiwen Chang 외

Priors are essential for reconstructing images from noisy and/or incomplete measurements. The choice of the prior determines both the quality and uncertainty of recovered images. We propose turning score-based diffusion …

DeblurringDenoisingVariational Inference

Uncertainty Quantification in HSI Reconstruction using Physics-Aware Diffusion Priors and Optics-Encoded Measurements

2025-11-23 · Juan Romero, Qiang Fu, Matteo Ravasi, Wolfgang Heidrich arxiv

Hyperspectral image reconstruction from a compressed measurement is a highly ill-posed inverse problem. Current data-driven methods suffer from hallucination due to the lack of spectral diversity in existing hyperspectra…

Image ReconstructionBayesian Inference

Consistency Diffusion Models for Single-Image 3D Reconstruction with Priors

2025-01-28 · Chenru Jiang, Chengrui Zhang, Xi Yang, Jie Sun 외

This paper delves into the study of 3D point cloud reconstruction from a single image. Our objective is to develop the Consistency Diffusion Model, exploring synergistic 2D and 3D priors in the Bayesian framework to ensu…

3D Point Cloud Reconstruction3D ReconstructionPoint cloud reconstruction