PIDSR: Complementary Polarized Image Demosaicing and Super-Resolution
Polarization cameras can capture multiple polarized images with different polarizer angles in a single shot, bringing convenience to polarization-based downstream tasks. However, their direct outputs are color-polarization filter array (CPFA) raw images, requiring demosaicing to reconstruct full-resolution, full-color polarized images; unfortunately, this necessary step introduces artifacts that make polarization-related parameters such as the degree of polarization (DoP) and angle of polarization (AoP) prone to error. Besides, limited by the hardware design, the resolution of a polarization camera is often much lower than that of a conventional RGB camera. Existing polarized image demosaicing (PID) methods are limited in that they cannot enhance resolution, while polarized image super-resolution (PISR) methods, though designed to obtain high-resolution (HR) polarized images from the demosaicing results, tend to retain or even amplify errors in the DoP and AoP introduced by demosaicing artifacts. In this paper, we propose PIDSR, a joint framework that performs complementary Polarized Image Demosaicing and Super-Resolution, showing the ability to robustly obtain high-quality HR polarized images with more accurate DoP and AoP from a CPFA raw image in a direct manner. Experiments show our PIDSR not only achieves state-of-the-art performance on both synthetic and real data, but also facilitates downstream tasks.
Code (1)
Tasks
DemosaickingImage Super-ResolutionSuper-ResolutionSimilar Papers 제목 키워드 기반
A Sparse Representation Based Joint Demosaicing Method for Single-Chip Polarized Color Sensor
The emergence of the single-chip polarized color sensor now allows for simultaneously capturing chromatic and polarimetric information of the scene on a monochromatic image plane. However, unlike the usual camera with an…
DemosaickingDeep Residual Network for Joint Demosaicing and Super-Resolution
In digital photography, two image restoration tasks have been studied extensively and resolved independently: demosaicing and super-resolution. Both these tasks are related to resolution limitations of the camera. Perfor…
DemosaickingImage RestorationSSIMSuper-ResolutionJoint Demosaicing and Denoising With Self Guidance
Usually located at the very early stages of the computational photography pipeline, demosaicing and denoising play important parts in the modern camera image processing. Recently, some neural networks have shown the effe…
DemosaickingDenoisingImage RestorationJoint Demosaicing and Denoising+2Unsupervised Spectral Demosaicing with Lightweight Spectral Attention Networks
This paper presents a deep learning-based spectral demosaicing technique trained in an unsupervised manner. Many existing deep learning-based techniques relying on supervised learning with synthetic images, often underpe…
BenchmarkingDemosaickingEnd-to-End Learning for Joint Image Demosaicing, Denoising and Super-Resolution
Image denoising, demosaicing and super-resolution are key problems of image restoration well studied in the recent decades. Often, in practice, one has to solve these problems simultaneously. A problem of finding a j…
DemosaickingDenoisingImage DenoisingImage Restoration+1