Reliable Explainability of Deep Learning Spatial-Spectral Classifiers for Improved Semantic Segmentation in Autonomous Driving
Integrating hyperspectral imagery (HSI) with deep neural networks (DNNs) can strengthen the accuracy of intelligent vision systems by combining spectral and spatial information, which is useful for tasks like semantic segmentation in autonomous driving. To advance research in such safety-critical systems, determining the precise contribution of spectral information to complex DNNs' output is needed. To address this, several saliency methods, such as class activation maps (CAM), have been proposed primarily for image classification. However, recent studies have raised concerns regarding their reliability. In this paper, we address their limitations and propose an alternative approach by leveraging the data provided by activations and weights from relevant DNN layers to better capture the relationship between input features and predictions. The study aims to assess the superior performance of HSI compared to 3-channel and single-channel DNNs. We also address the influence of spectral signature normalization for enhancing DNN robustness in real-world driving conditions.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous Drivingimage-classificationImage ClassificationSemantic SegmentationSimilar Papers 제목 키워드 기반
mHC-HSI: Clustering-Guided Hyper-Connection Mamba for Hyperspectral Image Classification
Recently, DeepSeek has invented the manifold-constrained hyper-connection (mHC) approach which has demonstrated significant improvements over the traditional residual connection in deep learning models \cite{xie2026mhc}.…
Hyperspectral Image ClassificationImproving EEG Signal Classification Accuracy Using Wasserstein Generative Adversarial Networks
Electroencephalography (EEG) plays a vital role in recording brain activities and is integral to the development of brain-computer interface (BCI) technologies. However, the limited availability and high variability of E…
Brain Computer InterfaceEEGEEG Signal ClassificationGenerative Adversarial NetworkS2RC-GCN: A Spatial-Spectral Reliable Contrastive Graph Convolutional Network for Complex Land Cover Classification Using Hyperspectral Images
Spatial correlations between different ground objects are an important feature of mining land cover research. Graph Convolutional Networks (GCNs) can effectively capture such spatial feature representations and have demo…
ClassificationContrastive LearningLand Cover ClassificationShapelet-based Sparse Representation for Landcover Classification of Hyperspectral Images
This paper presents a sparse representation-based classification approach with a novel dictionary construction procedure. By using the constructed dictionary sophisticated prior knowledge about the spatial nature of the …
Classification Of Hyperspectral ImagesGeneral ClassificationSparse Representation-based ClassificationExplainability-Driven Dimensionality Reduction for Hyperspectral Imaging
Hyperspectral imaging (HSI) provides rich spectral information for precise material classification and analysis; however, its high dimensionality introduces a computational burden and redundancy, making dimensionality re…
Dimensionality Reduction