paper-with-me

Papers

ParamISP: Learned Forward and Inverse ISPs using Camera Parameters

2023-12-20 · CVPR 2024 1 · Woohyeok Kim, GeonU Kim, Junyong Lee, Seungyong Lee, Seung-Hwan Baek, Sunghyun Cho

RAW images are rarely shared mainly due to its excessive data size compared to their sRGB counterparts obtained by camera ISPs. Learning the forward and inverse processes of camera ISPs has been recently demonstrated, enabling physically-meaningful RAW-level image processing on input sRGB images. However, existing learning-based ISP methods fail to handle the large variations in the ISP processes with respect to camera parameters such as ISO and exposure time, and have limitations when used for various applications. In this paper, we propose ParamISP, a learning-based method for forward and inverse conversion between sRGB and RAW images, that adopts a novel neural-network module to utilize camera parameters, which is dubbed as ParamNet. Given the camera parameters provided in the EXIF data, ParamNet converts them into a feature vector to control the ISP networks. Extensive experiments demonstrate that ParamISP achieve superior RAW and sRGB reconstruction results compared to previous methods and it can be effectively used for a variety of applications such as deblurring dataset synthesis, raw deblurring, HDR reconstruction, and camera-to-camera transfer.

📄 PDF Abstract BibTeX arXiv:2312.13313

Code (1)

woo525/ParamISP 공식 구현 pytorch

Tasks

DeblurringHDR Reconstruction

Similar Papers 제목 키워드 기반

Uni-ISP: Unifying the Learning of ISPs from Multiple Cameras

2024-06-03 · Lingen Li, Mingde Yao, Xingyu Meng, Muquan Yu 외

Modern end-to-end image signal processors (ISPs) can learn complex mappings from RAW/XYZ data to sRGB (or inverse), opening new possibilities in image processing. However, as the diversity of camera models continues to e…

4k

Rawformer: Unpaired Raw-to-Raw Translation for Learnable Camera ISPs

2024-04-16 · Georgy Perevozchikov, Nancy Mehta, Mahmoud Afifi, Radu Timofte

Modern smartphone camera quality heavily relies on the image signal processor (ISP) to enhance captured raw images, utilizing carefully designed modules to produce final output images encoded in a standard color space (e…

DecoderTranslation

Learned Global Optimization for Inverse Scattering Problems -- Matching Global Search with Computational Efficiency

2021-07-01 · Marco Salucci, Lorenzo Poli, Paolo Rocca, Andrea Massa

The computationally-efficient solution of fully non-linear microwave inverse scattering problems (ISPs) is addressed. An innovative System-by-Design (SbD) based method is proposed to enable, for the first time to the bes…

Computational Efficiencyglobal-optimization

NILUT: Conditional Neural Implicit 3D Lookup Tables for Image Enhancement

2023-06-20 · Marcos V. Conde, Javier Vazquez-Corral, Michael S. Brown, Radu Timofte

3D lookup tables (3D LUTs) are a key component for image enhancement. Modern image signal processors (ISPs) have dedicated support for these as part of the camera rendering pipeline. Cameras typically provide multiple op…

Color ManipulationImage EnhancementPhoto RetouchingTone Mapping

Linear-Model-inspired Neural Network for Electromagnetic Inverse Scattering

2020-10-20

Electromagnetic inverse scattering problems (ISPs) aim to retrieve permittivities of dielectric scatterers from the scattering measurement. It is often highly nonlinear, caus-ing the problem to be very difficult to solve…

parameter estimation