Bracket Diffusion: HDR Image Generation by Consistent LDR Denoising
We demonstrate generating HDR images using the concerted action of multiple black-box, pre-trained LDR image diffusion models. Relying on a pre-trained LDR generative diffusion models is vital as, first, there is no sufficiently large HDR image dataset available to re-train them, and, second, even if it was, re-training such models is impossible for most compute budgets. Instead, we seek inspiration from the HDR image capture literature that traditionally fuses sets of LDR images, called "exposure brackets'', to produce a single HDR image. We operate multiple denoising processes to generate multiple LDR brackets that together form a valid HDR result. The key to making this work is to introduce a consistency term into the diffusion process to couple the brackets such that they agree across the exposure range they share while accounting for possible differences due to the quantization error. We demonstrate state-of-the-art unconditional and conditional or restoration-type (LDR2HDR) generative modeling results, yet in HDR.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingImage GenerationQuantizationvalidMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Latent diffusion models for parameterization and data assimilation of facies-based geomodels
Geological parameterization entails the representation of a geomodel using a small set of latent variables and a mapping from these variables to grid-block properties such as porosity and permeability. Parameterization i…
DenoisingDimensionality ReductionImage GenerationRenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation
Diffusion models currently achieve state-of-the-art performance for both conditional and unconditional image generation. However, so far, image diffusion models do not support tasks required for 3D understanding, such as…
3D Generation3D ReconstructionDenoisingImage Denoising+3Residual Denoising Diffusion Models
We propose residual denoising diffusion models (RDDM), a novel dual diffusion process that decouples the traditional single denoising diffusion process into residual diffusion and noise diffusion. This dual diffusion fra…
DenoisingDiversityImage GenerationImage Restoration+1Linear Image Generation by Synthesizing Exposure Brackets
The life of a photo begins with photons striking the sensor, whose signals are passed through a sophisticated image signal processing (ISP) pipeline to produce a display-referred image. However, such images are no longer…
Image GenerationImage EditingPersonalized Generative Low-light Image Denoising and Enhancement
While smartphone cameras today can produce astonishingly good photos, their performance in low light is still not completely satisfactory because of the fundamental limits in photon shot noise and sensor read noise. Gene…
DenoisingImage DenoisingImage Restoration