FlexHDR: Modelling Alignment and Exposure Uncertainties for Flexible HDR Imaging
High dynamic range (HDR) imaging is of fundamental importance in modern digital photography pipelines and used to produce a high-quality photograph with well exposed regions despite varying illumination across the image. This is typically achieved by merging multiple low dynamic range (LDR) images taken at different exposures. However, over-exposed regions and misalignment errors due to poorly compensated motion result in artefacts such as ghosting. In this paper, we present a new HDR imaging technique that specifically models alignment and exposure uncertainties to produce high quality HDR results. We introduce a strategy that learns to jointly align and assess the alignment and exposure reliability using an HDR-aware, uncertainty-driven attention map that robustly merges the frames into a single high quality HDR image. Further, we introduce a progressive, multi-stage image fusion approach that can flexibly merge any number of LDR images in a permutation-invariant manner. Experimental results show our method can produce better quality HDR images with up to 1.1dB PSNR improvement to the state-of-the-art, and subjective improvements in terms of better detail, colours, and fewer artefacts.
Code (0)
등록된 구현이 없습니다.
Tasks
Models AlignmentSimilar Papers 제목 키워드 기반
Video Activity Localisation with Uncertainties in Temporal Boundary
Current methods for video activity localisation over time assume implicitly that activity temporal boundaries labelled for model training are determined and precise. However, in unscripted natural videos, different activ…
Dynamics modelling and path optimization for the on-orbit assembly of large flexible structures using a multi-arm robot
This paper presents a comprehensive methodology for modeling an on-orbit assembly mission scenario of a large flexible structure using a multi-arm robot. This methodology accounts for significant changes in inertia and f…
There and Back Again: A Flexible-Frame Transformer for Multi-Exposure Fusion
Multi-exposure fusion (MEF) brings the dynamic range of conventional cameras closer to that of human vision, producing images with rich scene content. Given the large variability in scene luminance, exposure strategies o…
Bridging Sequence-Structure Alignment in RNA Foundation Models
The alignment between RNA sequences and structures in foundation models (FMs) has yet to be thoroughly investigated. Existing FMs have struggled to establish sequence-structure alignment, hindering the free flow of genom…
Bayesian ensemble learning for predicting health outcomes of multipollutant mixtures
We introduce the SoftBart approach from Bayesian ensemble learning to estimate the relationship between multipollutant mixtures and health on chronic exposures in epidemiology research. This approach offers several key a…
Ensemble LearningEpidemiology