Joint demosaicing and fusion of multiresolution coded acquisitions: A unified image formation and reconstruction method
Novel optical imaging devices allow for hybrid acquisition modalities such as compressed acquisitions with locally different spatial and spectral resolutions captured by a single focal plane array. In this work, we propose to model the capturing system of a multiresolution coded acquisition (MRCA) in a unified framework, which natively includes conventional systems such as those based on spectral/color filter arrays, compressed coded apertures, and multiresolution sensing. We also propose a model-based image reconstruction algorithm performing a joint demosaicing and fusion (JoDeFu) of any acquisition modeled in the MRCA framework. The JoDeFu reconstruction algorithm solves an inverse problem with a proximal splitting technique and is able to reconstruct an uncompressed image datacube at the highest available spatial and spectral resolution. An implementation of the code is available at https://github.com/danaroth83/jodefu.
Code (1)
Tasks
DemosaickingImage ReconstructionSimilar Papers 제목 키워드 기반
A Sparse Representation Based Joint Demosaicing Method for Single-Chip Polarized Color Sensor
The emergence of the single-chip polarized color sensor now allows for simultaneously capturing chromatic and polarimetric information of the scene on a monochromatic image plane. However, unlike the usual camera with an…
DemosaickingExamining Joint Demosaicing and Denoising for Single-, Quad-, and Nona-Bayer Patterns
Camera sensors have color filters arranged in a mosaic layout, traditionally following the Bayer pattern. Demosaicing is a critical step camera hardware applies to obtain a full-channel RGB image. Many smartphones now ha…
DemosaickingDenoisingJoint Demosaicing and DenoisingJoint Demosaicing and Denoising With Self Guidance
Usually located at the very early stages of the computational photography pipeline, demosaicing and denoising play important parts in the modern camera image processing. Recently, some neural networks have shown the effe…
DemosaickingDenoisingImage RestorationJoint Demosaicing and Denoising+2Optimizing Codes for Source Separation in Color Image Demosaicing and Compressive Video Recovery
There exist several applications in image processing (eg: video compressed sensing [Hitomi, Y. et al, "Video from a single coded exposure photograph using a learned overcomplete dictionary"] and color image demosaicing […
compressed sensingDemosaickingLearning Deep Convolutional Networks for Demosaicing
This paper presents a comprehensive study of applying the convolutional neural network (CNN) to solving the demosaicing problem. The paper presents two CNN models that learn end-to-end mappings between the mosaic samples…
DemosaickingDenoising