Information loss from dimensionality reduction in 5D-Gaussian spectral data
Understanding the loss of information in spectral analytics is a crucial first step towards finding root causes for failures and uncertainties using spectral data in artificial intelligence models built from modern complex data science applications. Here, we show from an elementary Shannon entropy model analysis with quantum statistics of Gaussian distributed spectral data, that the relative loss of information from dimensionality reduction due to the projection of an initial five-dimensional dataset onto two-dimensional diagrams is less than one percent in the parameter range of small data sets with sample sizes on the order of few hundred data samples. From our analysis, we also conclude that the density and expectation value of the entropy probability distribution increases with the sample number and sample size using artificial data models derived from random sampling Monte Carlo simulation methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionSimilar Papers 제목 키워드 기반
A novel information gain-based approach for classification and dimensionality reduction of hyperspectral images
Recently, the hyperspectral sensors have improved our ability to monitor the earth surface with high spectral resolution. However, the high dimensionality of spectral data brings challenges for the image processing. Cons…
ClassificationClassification Of Hyperspectral ImagesDimensionality ReductionHyperspectral Images Classification and Dimensionality Reduction using spectral interaction and SVM classifier
Over the past decades, the hyperspectral remote sensing technology development has attracted growing interest among scientists in various domains. The rich and detailed spectral information provided by the hyperspectral …
ClassificationDimensionality ReductionA new filter for dimensionality reduction and classification of hyperspectral images using GLCM features and mutual information
Dimensionality reduction is an important preprocessing step of the hyperspectral images classification (HSI), it is inevitable task. Some methods use feature selection or extraction algorithms based on spectral and spati…
ClassificationClassification Of Hyperspectral ImagesDimensionality Reductionfeature selectionHybridization of filter and wrapper approaches for the dimensionality reduction and classification of hyperspectral images
The high dimensionality of hyperspectral images often imposes a heavy computational burden for image processing. Therefore, dimensionality reduction is often an essential step in order to remove the irrelevant, noisy and…
Classification Of Hyperspectral ImagesDimensionality ReductionA novel filter based on three variables mutual information for dimensionality reduction and classification of hyperspectral images
The high dimensionality of hyperspectral images (HSI) that contains more than hundred bands (images) for the same region called Ground Truth Map, often imposes a heavy computational burden for image processing and compli…
ClassificationClassification Of Hyperspectral ImagesDimensionality Reduction