Abandoning the Bayer-Filter to See in the Dark
Low-light image enhancement - a pervasive but challenging problem, plays a central role in enhancing the visibility of an image captured in a poor illumination environment. Due to the fact that not all photons can pass the Bayer-Filter on the sensor of the color camera, in this work, we first present a De-Bayer-Filter simulator based on deep neural networks to generate a monochrome raw image from the colored raw image. Next, a fully convolutional network is proposed to achieve the low-light image enhancement by fusing colored raw data with synthesized monochrome raw data. Channel-wise attention is also introduced to the fusion process to establish a complementary interaction between features from colored and monochrome raw images. To train the convolutional networks, we propose a dataset with monochrome and color raw pairs named Mono-Colored Raw paired dataset (MCR) collected by using a monochrome camera without Bayer-Filter and a color camera with Bayer-Filter. The proposed pipeline take advantages of the fusion of the virtual monochrome and the color raw images and our extensive experiments indicate that significant improvement can be achieved by leveraging raw sensor data and data-driven learning.
Code (1)
Tasks
Image EnhancementLow-Light Image EnhancementSimilar Papers 제목 키워드 기반
Efficient Unified Demosaicing for Bayer and Non-Bayer Patterned Image Sensors
As the physical size of recent CMOS image sensors (CIS) gets smaller, the latest mobile cameras are adopting unique non-Bayer color filter array (CFA) patterns (e.g., Quad, Nona, QxQ), which consist of homogeneous color …
DemosaickingMeta-LearningDouble Binnable RGB, RGBW and LMS Color Filter Arrays
New, high-resolution CMOS image sensors for mobile phones have moved beyond the single-binnable Quad Bayer and RGBW-Kodak patterns to the double binnable Hexadeca Bayer pattern featuring 4x4 tiles of like-colored pixels.…
DemosaickingExamining Joint Demosaicing and Denoising for Single-, Quad-, and Nona-Bayer Patterns
Camera sensors have color filters arranged in a mosaic layout, traditionally following the Bayer pattern. Demosaicing is a critical step camera hardware applies to obtain a full-channel RGB image. Many smartphones now ha…
DemosaickingDenoisingJoint Demosaicing and DenoisingSAGAN: Adversarial Spatial-asymmetric Attention for Noisy Nona-Bayer Reconstruction
Nona-Bayer colour filter array (CFA) pattern is considered one of the most viable alternatives to traditional Bayer patterns. Despite the substantial advantages, such non-Bayer CFA patterns are susceptible to produce vis…
Image ReconstructionJoint Demosaicing and DenoisingPyNET-QxQ: An Efficient PyNET Variant for QxQ Bayer Pattern Demosaicing in CMOS Image Sensors
Deep learning-based image signal processor (ISP) models for mobile cameras can generate high-quality images that rival those of professional DSLR cameras. However, their computational demands often make them unsuitable f…
DemosaickingKnowledge Distillation