Modelling the Scene Dependent Imaging in Cameras with a Deep Neural Network
We present a novel deep learning framework that models the scene dependent image processing inside cameras. Often called as the radiometric calibration, the process of recovering RAW images from processed images (JPEG format in the sRGB color space) is essential for many computer vision tasks that rely on physically accurate radiance values. All previous works rely on the deterministic imaging model where the color transformation stays the same regardless of the scene and thus they can only be applied for images taken under the manual mode. In this paper, we propose a data-driven approach to learn the scene dependent and locally varying image processing inside cameras under the automode. Our method incorporates both the global and the local scene context into pixel-wise features via multi-scale pyramid of learnable histogram layers. The results show that we can model the imaging pipeline of different cameras that operate under the automode accurately in both directions (from RAW to sRGB, from sRGB to RAW) and we show how we can apply our method to improve the performance of image deblurring.
Code (0)
등록된 구현이 없습니다.
Tasks
DeblurringImage DeblurringSimilar Papers 제목 키워드 기반
Noise2Image: Noise-Enabled Static Scene Recovery for Event Cameras
Event cameras, also known as dynamic vision sensors, are an emerging modality for measuring fast dynamics asynchronously. Event cameras capture changes of log-intensity over time as a stream of 'events' and generally can…
High-Speed Dynamic 3D Imaging with Sensor Fusion Splatting
Capturing and reconstructing high-speed dynamic 3D scenes has numerous applications in computer graphics, vision, and interdisciplinary fields such as robotics, aerodynamics, and evolutionary biology. However, achieving …
Sensor FusionEvent-based Asynchronous HDR Imaging by Temporal Incident Light Modulation
Dynamic Range (DR) is a pivotal characteristic of imaging systems. Current frame-based cameras struggle to achieve high dynamic range imaging due to the conflict between globally uniform exposure and spatially variant sc…
A Flexible Multi-view Multi-modal Imaging System for Outdoor Scenes
Multi-view imaging systems enable uniform coverage of 3D space and reduce the impact of occlusion, which is beneficial for 3D object detection and tracking accuracy. However, existing imaging systems built with multi-vie…
3D Object DetectionObjectobject-detectionObject DetectionEvent fields: Capturing light fields at high speed, resolution, and dynamic range
Event cameras, which feature pixels that independently respond to changes in brightness, are becoming increasingly popular in high-speed applications due to their lower latency, reduced bandwidth requirements, and enhanc…
Depth EstimationScene Understanding