paper-with-me

Papers

Image Neural Field Diffusion Models

2024-06-11 · CVPR 2024 1 · Yinbo Chen, Oliver Wang, Richard Zhang, Eli Shechtman, Xiaolong Wang, Michael Gharbi

Diffusion models have shown an impressive ability to model complex data distributions, with several key advantages over GANs, such as stable training, better coverage of the training distribution's modes, and the ability to solve inverse problems without extra training. However, most diffusion models learn the distribution of fixed-resolution images. We propose to learn the distribution of continuous images by training diffusion models on image neural fields, which can be rendered at any resolution, and show its advantages over fixed-resolution models. To achieve this, a key challenge is to obtain a latent space that represents photorealistic image neural fields. We propose a simple and effective method, inspired by several recent techniques but with key changes to make the image neural fields photorealistic. Our method can be used to convert existing latent diffusion autoencoders into image neural field autoencoders. We show that image neural field diffusion models can be trained using mixed-resolution image datasets, outperform fixed-resolution diffusion models followed by super-resolution models, and can solve inverse problems with conditions applied at different scales efficiently.

📄 PDF Abstract BibTeX arXiv:2406.07480

Code (0)

등록된 구현이 없습니다.

Tasks

Super-Resolution

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

DDRF: Denoising Diffusion Model for Remote Sensing Image Fusion

2023-04-10 · ZiHan Cao, ShiQi Cao, Xiao Wu, JunMing Hou 외

Denosing diffusion model, as a generative model, has received a lot of attention in the field of image generation recently, thanks to its powerful generation capability. However, diffusion models have not yet received su…

DenoisingImage GenerationImage-to-Image TranslationStyle Transfer

Synthesizing PET images from High-field and Ultra-high-field MR images Using Joint Diffusion Attention Model

2023-05-06 · Taofeng Xie, Chentao Cao, Zhuoxu Cui, Yu Guo 외

MRI and PET are crucial diagnostic tools for brain diseases, as they provide complementary information on brain structure and function. However, PET scanning is costly and involves radioactive exposure, resulting in a la…

DiagnosticVocal Bursts Intensity Prediction

Diffusion Probabilistic Fields

2023-03-01 · Peiye Zhuang, Samira Abnar, Jiatao Gu, Alex Schwing 외

Diffusion probabilistic models have quickly become a major approach for generative modeling of images, 3D geometry, video and other domains. However, to adapt diffusion generative modeling to these domains the denoising …

3D geometryDenoising

DiffRF: Rendering-Guided 3D Radiance Field Diffusion

2022-12-02 · CVPR 2023 1 · Norman Müller, Yawar Siddiqui, Lorenzo Porzi, Samuel Rota Bulò 외

We introduce DiffRF, a novel approach for 3D radiance field synthesis based on denoising diffusion probabilistic models. While existing diffusion-based methods operate on images, latent codes, or point cloud data, we are…

Denoising

FSDiffReg: Feature-wise and Score-wise Diffusion-guided Unsupervised Deformable Image Registration for Cardiac Images

2023-07-22 · Yi Qin, Xiaomeng Li

Unsupervised deformable image registration is one of the challenging tasks in medical imaging. Obtaining a high-quality deformation field while preserving deformation topology remains demanding amid a series of deep-lear…

Image Registration