Deep Camera: A Fully Convolutional Neural Network for Image Signal Processing
A conventional camera performs various signal processing steps sequentially to reconstruct an image from a raw Bayer image. When performing these processing in multiple stages the residual error from each stage accumulates in the image and degrades the quality of the final reconstructed image. In this paper, we present a fully convolutional neural network (CNN) to perform defect pixel correction, denoising, white balancing, exposure correction, demosaicing, color transform, and gamma encoding. To our knowledge, this is the first CNN trained end-to-end to perform the entire image signal processing pipeline in a camera. The neural network was trained using a large image database of raw Bayer images. Through extensive experiments, we show that the proposed CNN based image signal processing system performs better than the conventional signal processing pipelines that perform the processing sequentially.
Code (0)
등록된 구현이 없습니다.
Tasks
DemosaickingDenoisingExposure CorrectionSimilar Papers 제목 키워드 기반
Object Detection and 3D Estimation via an FMCW Radar Using a Fully Convolutional Network
This paper considers object detection and 3D estimation using an FMCW radar. The state-of-the-art deep learning framework is employed instead of using traditional signal processing. In preparing the radar training data, …
Objectobject-detectionObject DetectionPositionEnd-to-End Denoising of Dark Burst Images Using Recurrent Fully Convolutional Networks
When taking photos in dim-light environments, due to the small amount of light entering, the shot images are usually extremely dark, with a great deal of noise, and the color cannot reflect real-world color. Under this c…
DenoisingImage DenoisingRAWtoBit: A Fully End-to-end Camera ISP Network
Image compression is an essential and last processing unit in the camera image signal processing (ISP) pipeline. While many studies have been made to replace the conventional ISP pipeline with a single end-to-end optimiz…
Image CompressionKnowledge DistillationCameraNet: A Two-Stage Framework for Effective Camera ISP Learning
Traditional image signal processing (ISP) pipeline consists of a set of individual image processing components onboard a camera to reconstruct a high-quality sRGB image from the sensor raw data. Due to the hand-crafted n…
DemosaickingDenoisingImage DenoisingVocal Bursts Valence PredictionComputational Optics for Mobile Terminals in Mass Production
Correcting the optical aberrations and the manufacturing deviations of cameras is a challenging task. Due to the limitation on volume and the demand for mass production, existing mobile terminals cannot rectify optical d…