Deep-learning-based on-chip rapid spectral imaging with high spatial resolution
Spectral imaging extends the concept of traditional color cameras to capture images across multiple spectral channels and has broad application prospects. Conventional spectral cameras based on scanning methods suffer from low acquisition speed and large volume. On-chip computational spectral imaging based on metasurface filters provides a promising scheme for portable applications, but endures long computation time for point-by-point iterative spectral reconstruction and mosaic effect in the reconstructed spectral images. In this study, we demonstrated on-chip rapid spectral imaging eliminating the mosaic effect in the spectral image by deep-learning-based spectral data cube reconstruction. We experimentally achieved four orders of magnitude speed improvement than iterative spectral reconstruction and high fidelity of spectral reconstruction over 99% for a standard color board. In particular, we demonstrated video-rate spectral imaging for moving objects and outdoor driving scenes with good performance for recognizing metamerism, where the concolorous sky and white cars can be distinguished via their spectra, showing great potential for autonomous driving and other practical applications in the field of intelligent perception.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingMetamerismSpectral ReconstructionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deeply Learned Filter Response Functions for Hyperspectral Reconstruction
Hyperspectral reconstruction from RGB imaging has recently achieved significant progress via sparse coding and deep learning. However, a largely ignored fact is that existing RGB cameras are tuned to mimic human richrom…
Spectral ReconstructionSnapshot multi-spectral imaging through defocusing and a Fourier imager network
Multi-spectral imaging, which simultaneously captures the spatial and spectral information of a scene, is widely used across diverse fields, including remote sensing, biomedical imaging, and agricultural monitoring. Here…
Image ReconstructionA deep learning framework for morphologic detail beyond the diffraction limit in infrared spectroscopic imaging
Infrared (IR) microscopes measure spectral information that quantifies molecular content to assign the identity of biomedical cells but lack the spatial quality of optical microscopy to appreciate morphologic features. H…
Image Super-ResolutionSuper-ResolutionCompressive single-pixel imaging via a wavelength-multiplexed spatially incoherent diffractive optical processor
Despite offering high sensitivity, a high signal-to-noise ratio, and a broad spectral range, single-pixel imaging (SPI) is limited by low measurement efficiency and long data-acquisition times. To address this, we propos…
Snapshot fiber spectral imaging using speckle correlations and compressive sensing
Snapshot spectral imaging is rapidly gaining interest for remote sensing applications. Acquiring spatial and spectral data within one image promotes fast measurement times, and reduces the need for stabilized scanning im…
Compressive Sensing