Programmable Spectrometry -- Per-pixel Classification of Materials using Learned Spectral Filters
Many materials have distinct spectral profiles. This facilitates estimation of the material composition of a scene at each pixel by first acquiring its hyperspectral image, and subsequently filtering it using a bank of spectral profiles. This process is inherently wasteful since only a set of linear projections of the acquired measurements contribute to the classification task. We propose a novel programmable camera that is capable of producing images of a scene with an arbitrary spectral filter. We use this camera to optically implement the spectral filtering of the scene's hyperspectral image with the bank of spectral profiles needed to perform per-pixel material classification. This provides gains both in terms of acquisition speed --- since only the relevant measurements are acquired --- and in signal-to-noise ratio --- since we invariably avoid narrowband filters that are light inefficient. Given training data, we use a range of classical and modern techniques including SVMs and neural networks to identify the bank of spectral profiles that facilitate material classification. We verify the method in simulations on standard datasets as well as real data using a lab prototype of the camera.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationMaterial ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
96 dB Linear High Dynamic Range CAOS Spectrometer Demonstration
For the first time, a CAOS (i.e., Coded Access Optical Sensor) spectrometer is demonstrated. The design implemented uses a reflective diffraction grating and a time-frequency CAOS mode operations Digital Micromirror Devi…
Vocal Bursts Intensity PredictionDeep Learning for Tumor Classification in Imaging Mass Spectrometry
Motivation: Tumor classification using Imaging Mass Spectrometry (IMS) data has a high potential for future applications in pathology. Due to the complexity and size of the data, automated feature extraction and classifi…
ClassificationDeep LearningGeneral ClassificationSensitivityEvolving Programmable Computational Metamaterials
Granular metamaterials are a promising choice for the realization of mechanical computing devices. As preliminary evidence of this, we demonstrate here how to embed Boolean logic gates (AND and XOR) into a granular metam…
Inverse designing metamaterials with programmable nonlinear functional responses in graph space
Material responses to static and dynamic stimuli, represented as nonlinear curves, are design targets for engineering functionalities like structural support, impact protection, and acoustic and photonic bandgaps. Three-…
Mass spectrometry analysis using MALDIquant
MALDIquant and associated R packages provide a versatile and completely free open-source platform for analyzing 2D mass spectrometry data as generated for instance by MALDI and SELDI instruments. We first describe the va…