Explaining Neural Network Predictions for Functional Data Using Principal Component Analysis and Feature Importance
Optical spectral-temporal signatures extracted from videos of explosions provide information for identifying characteristics of the corresponding explosive devices. Currently, the identification is done using heuristic algorithms and direct subject matter expert review. An improvement in predictive performance may be obtained by using machine learning, but this application lends itself to high consequence national security decisions, so it is not only important to provide high accuracy but clear explanations for the predictions to garner confidence in the model. While much work has been done to develop explainability methods for machine learning models, not much of the work focuses on situations with input variables of the form of functional data such optical spectral-temporal signatures. We propose a procedure for explaining machine learning models fit using functional data that accounts for the functional nature the data. Our approach makes use of functional principal component analysis (fPCA) and permutation feature importance (PFI). fPCA is used to transform the functions to create uncorrelated functional principal components (fPCs). The model is trained using the fPCs as inputs, and PFI is applied to identify the fPCs important to the model for prediction. Visualizations are used to interpret the variability explained by the fPCs that are found to be important by PFI to determine the aspects of the functions that are important for prediction. We demonstrate the technique by explaining neural networks fit to explosion optical spectral-temporal signatures for predicting characteristics of the explosive devices.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningFeature ImportanceSimilar Papers 제목 키워드 기반
Identifying Neural Signatures from fMRI using Hybrid Principal Components Regression
Recent advances in neuroimaging analysis have enabled accurate decoding of mental state from brain activation patterns during functional magnetic resonance imaging scans. A commonly applied tool for this purpose is princ…
On the estimation of the number of components in multivariate functional principal component analysis
Happ and Greven (2018) developed a methodology for principal components analysis of multivariate functional data observed on different dimensional domains. Their approach relies on an estimation of univariate functional …
Functional Principal Component Analysis as a Versatile Technique to Understand and Predict the Electric Consumption Patterns
Understanding and predicting the electric consumption patterns in the short-, mid- and long-term, at the distribution and transmission level, is a fundamental asset for smart grids infrastructure planning, dynamic networ…
An Explainable Pipeline for Machine Learning with Functional Data
Machine learning (ML) models have shown success in applications with an objective of prediction, but the algorithmic complexity of some models makes them difficult to interpret. Methods have been proposed to provide insi…
Feature ImportanceOn the use of the Gram matrix for multivariate functional principal components analysis
Dimension reduction is crucial in functional data analysis (FDA). The key tool to reduce the dimension of the data is functional principal component analysis. Existing approaches for functional principal component analys…
Dimensionality Reduction