paper-with-me

Papers

Self-Supervised High Dynamic Range Imaging with Multi-Exposure Images in Dynamic Scenes

2023-10-03 · Zhilu Zhang, Haoyu Wang, Shuai Liu, Xiaotao Wang, Lei Lei, WangMeng Zuo

Merging multi-exposure images is a common approach for obtaining high dynamic range (HDR) images, with the primary challenge being the avoidance of ghosting artifacts in dynamic scenes. Recent methods have proposed using deep neural networks for deghosting. However, the methods typically rely on sufficient data with HDR ground-truths, which are difficult and costly to collect. In this work, to eliminate the need for labeled data, we propose SelfHDR, a self-supervised HDR reconstruction method that only requires dynamic multi-exposure images during training. Specifically, SelfHDR learns a reconstruction network under the supervision of two complementary components, which can be constructed from multi-exposure images and focus on HDR color as well as structure, respectively. The color component is estimated from aligned multi-exposure images, while the structure one is generated through a structure-focused network that is supervised by the color component and an input reference (\eg, medium-exposure) image. During testing, the learned reconstruction network is directly deployed to predict an HDR image. Experiments on real-world images demonstrate our SelfHDR achieves superior results against the state-of-the-art self-supervised methods, and comparable performance to supervised ones. Codes are available at https://github.com/cszhilu1998/SelfHDR

📄 PDF Abstract BibTeX arXiv:2310.01840

Code (1)

cszhilu1998/selfhdr 공식 구현 pytorch

Tasks

HDR Reconstruction

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

HDR Imaging for Dynamic Scenes with Events

2024-04-04 · Li Xiaopeng, Zeng Zhaoyuan, Fan Cien, Zhao Chen 외

High dynamic range imaging (HDRI) for real-world dynamic scenes is challenging because moving objects may lead to hybrid degradation of low dynamic range and motion blur. Existing event-based approaches only focus on a s…

DeblurringSelf-Supervised Learning

Deep Lightweight Unrolled Network for High Dynamic Range Modulo Imaging

2026-01-18 · Brayan Monroy, Jorge Bacca arxiv

Modulo-Imaging (MI) offers a promising alternative for expanding the dynamic range of images by resetting the signal intensity when it reaches the saturation level. Subsequently, high-dynamic range (HDR) modulo imaging r…

Tasting the cake: evaluating self-supervised generalization on out-of-distribution multimodal MRI data

2021-03-29 · Alex Fedorov, Eloy Geenjaar, Lei Wu, Thomas P. DeRamus 외

Self-supervised learning has enabled significant improvements on natural image benchmarks. However, there is less work in the medical imaging domain in this area. The optimal models have not yet been determined among the…

Out-of-Distribution GeneralizationSelf-Supervised Learning

Self-supervised HDR Imaging from Motion and Exposure Cues

2022-03-23 · Michal Nazarczuk, Sibi Catley-Chandar, Ales Leonardis, Eduardo Pérez Pellitero

Recent High Dynamic Range (HDR) techniques extend the capabilities of current cameras where scenes with a wide range of illumination can not be accurately captured with a single low-dynamic-range (LDR) image. This is gen…

SMAE: Few-shot Learning for HDR Deghosting with Saturation-Aware Masked Autoencoders

2023-04-14 · CVPR 2023 1 · Qingsen Yan, Song Zhang, Weiye Chen, Hao Tang 외

Generating a high-quality High Dynamic Range (HDR) image from dynamic scenes has recently been extensively studied by exploiting Deep Neural Networks (DNNs). Most DNNs-based methods require a large amount of training dat…

Few-Shot LearningPseudo Label