Differentiable Programming for Hyperspectral Unmixing using a Physics-based Dispersion Model
Hyperspectral unmixing is an important remote sensing task with applications including material identification and analysis. Characteristic spectral features make many pure materials identifiable from their visible-to-infrared spectra, but quantifying their presence within a mixture is a challenging task due to nonlinearities and factors of variation. In this paper, spectral variation is considered from a physics-based approach and incorporated into an end-to-end spectral unmixing algorithm via differentiable programming. The dispersion model is introduced to simulate realistic spectral variation, and an efficient method to fit the parameters is presented. Then, this dispersion model is utilized as a generative model within an analysis-by-synthesis spectral unmixing algorithm. Further, a technique for inverse rendering using a convolutional neural network to predict parameters of the generative model is introduced to enhance performance and speed when training data is available. Results achieve state-of-the-art on both infrared and visible-to-near-infrared (VNIR) datasets, and show promise for the synergy between physics-based models and deep learning in hyperspectral unmixing in the future.
Code (1)
Tasks
Hyperspectral UnmixingInverse RenderingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Integration of Physics-Based and Data-Driven Models for Hyperspectral Image Unmixing
Spectral unmixing is one of the most important quantitative analysis tasks in hyperspectral data processing. Conventional physics-based models are characterized by clear interpretation. However they may not be suitable f…
Hyperspectral UnmixingHyperspectral unmixing for Raman spectroscopy via physics-constrained autoencoders
Raman spectroscopy is widely used across scientific domains to characterize the chemical composition of samples in a non-destructive, label-free manner. Many applications entail the unmixing of signals from mixtures of m…
Hyperspectral UnmixingSpectral Unmixing Comparison with Sparse, Iterative and Mixed Integer Programming Models
Hyperspectral unmixing is the analytical process of determining the pure materials and estimating the proportions of such materials composed within an observed mixed pixel spectrum. We can unmix mixed pixel spectra using…
Hyperspectral image analysisHyperspectral UnmixingregressionHyperspectral Unmixing of Agricultural Images taken from UAV Using Adapted U-Net Architecture
The hyperspectral unmixing method is an algorithm that extracts material (usually called endmember) data from hyperspectral data cube pixels along with their abundances. Due to a lower spatial resolution of hyperspectral…
Hyperspectral UnmixingA Dual Symmetric Gauss-Seidel Alternating Direction Method of Multipliers for Hyperspectral Sparse Unmixing
Since sparse unmixing has emerged as a promising approach to hyperspectral unmixing, some spatial-contextual information in the hyperspectral images has been exploited to improve the performance of the unmixing recently.…
Hyperspectral Unmixing