paper-with-me

Papers

Deep convolutional demosaicking network for multispectral polarization filter array

2024-06-08 · Tomoharu Ishiuchi, Kazuma Shinoda

To address the demosaicking problem in multispectral polarization filter array (MSPFA) imaging, we propose a multispectral polarization demosaicking network (MSPDNet) that improves image reconstruction accuracy. Imaging with a multispectral polarization filter array acquires multispectral polarization information in a snapshot. The full-resolution multispectral polarization image must be reconstructed from a mosaic image. In the proposed method, a sparse image in which pixel values of the same channel are extracted from a mosaic image is used as input to MSPDNet. Missing pixels are interpolated by learning spatial and wavelength correlations from the observed pixels in the mosaic image. Moreover, by using 3D convolution, features are extracted at each convolution layer, and by deepening the network, even detailed features of the multispectral polarization image can be learned. Experimental results show that MSPDNet can reconstruct multi-wavelength and multi-polarization angle information with high accuracy in terms of peak signal-to-noise ratio (PSNR) evaluation and visual quality, indicating the effectiveness of the proposed method compared to other methods.

📄 PDF Abstract BibTeX arXiv:2406.05312

Code (0)

등록된 구현이 없습니다.

Tasks

DemosaickingImage Reconstruction

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Deep demosaicking for multispectral filter arrays

2018-10-22

We propose a novel demosaicking method for multispectral filter arrays based on a deep convolutional neural network. The proposed method first interpolates mosaicked multispectral images utilizing a bilinear approach, th…

Demosaicking

Snapshot multispectral imaging using a filter array

2018-08-28

A multispectral filter array (MSFA) is one solution for capturing a multispectral image (MSI) in a single shot at low cost. We introduce our optimization method of the spectral sensitivity of the MSFAs and demosaicking, …

DemosaickingSensitivity

Monochrome and Color Polarization Demosaicking Using Edge-Aware Residual Interpolation

2020-07-28 · Miki Morimatsu, Yusuke Monno, Masayuki Tanaka, Masatoshi Okutomi

A division-of-focal-plane or microgrid image polarimeter enables us to acquire a set of polarization images in one shot. Since the polarimeter consists of an image sensor equipped with a monochrome or color polarization …

Demosaicking

CPDDNet: Color-Polarization Denoising and Demosaicking Network

2026-07-01 · Qihang Zhang, Yusuke Monno, Masayuki Tanaka, Masatoshi Okutomi arxiv

Color-polarization imaging using a color-polarization filter array (CPFA) sensor captures both texture (color intensity) and physical (polarization) information of the scene in a single shot, enabling various application…

Polarization Uncertainty-Guided Diffusion Model for Color Polarization Image Demosaicking

2026-02-27 · Chenggong Li, Yidong Luo, Junchao Zhang, Degui Yang arxiv

Color polarization demosaicking (CPDM) aims to reconstruct full-resolution polarization images of four directions from the color-polarization filter array (CPFA) raw image. Due to the challenge of predicting numerous mis…