Efficient and Accurate Hyperspectral Image Demosaicing with Neural Network Architectures
Neural network architectures for image demosaicing have been become more and more complex. This results in long training periods of such deep networks and the size of the networks is huge. These two factors prevent practical implementation and usage of the networks in real-time platforms, which generally only have limited resources. This study investigates the effectiveness of neural network architectures in hyperspectral image demosaicing. We introduce a range of network models and modifications, and compare them with classical interpolation methods and existing reference network approaches. The aim is to identify robust and efficient performing network architectures. Our evaluation is conducted on two datasets, "SimpleData" and "SimRealData," representing different degrees of realism in multispectral filter array (MSFA) data. The results indicate that our networks outperform or match reference models in both datasets demonstrating exceptional performance. Notably, our approach focuses on achieving correct spectral reconstruction rather than just visual appeal, and this emphasis is supported by quantitative and qualitative assessments. Furthermore, our findings suggest that efficient demosaicing solutions, which require fewer parameters, are essential for practical applications. This research contributes valuable insights into hyperspectral imaging and its potential applications in various fields, including medical imaging.
Code (0)
등록된 구현이 없습니다.
Tasks
DemosaickingSpectral ReconstructionSimilar Papers 제목 키워드 기반
Hy-demosaicing: Hyperspectral blind reconstruction from spectral subsampling
This article proposes a smart hyperspectral sensing strategy, implemented in the spectral domain, conceived for spaceborne sensor systems, where physical space, storage resources, and communication bandwidth are extremel…
DemosaickingHyperspectral Demosaicing of Snapshot Camera Images Using Deep Learning
Spectral imaging technologies have rapidly evolved during the past decades. The recent development of single-camera-one-shot techniques for hyperspectral imaging allows multiple spectral bands to be captured simultaneous…
Deep LearningDemosaickingGeneralized Inpainting Method for Hyperspectral Image Acquisition
A recently designed hyperspectral imaging device enables multiplexed acquisition of an entire data volume in a single snapshot thanks to monolithically-integrated spectral filters. Such an agile imaging technique comes a…
compressed sensingDemosaickingUnsupervised Spectral Demosaicing with Lightweight Spectral Attention Networks
This paper presents a deep learning-based spectral demosaicing technique trained in an unsupervised manner. Many existing deep learning-based techniques relying on supervised learning with synthetic images, often underpe…
BenchmarkingDemosaickingMSFA-Frequency-Aware Transformer for Hyperspectral Images Demosaicing
Hyperspectral imaging systems that use multispectral filter arrays (MSFA) capture only one spectral component in each pixel. Hyperspectral demosaicing is used to recover the non-measured components. While deep learning m…
Demosaicking