Efficient Uncertainty Estimation in Spiking Neural Networks via MC-dropout
Spiking neural networks (SNNs) have gained attention as models of sparse and event-driven communication of biological neurons, and as such have shown increasing promise for energy-efficient applications in neuromorphic hardware. As with classical artificial neural networks (ANNs), predictive uncertainties are important for decision making in high-stakes applications, such as autonomous vehicles, medical diagnosis, and high frequency trading. Yet, discussion of uncertainty estimation in SNNs is limited, and approaches for uncertainty estimation in artificial neural networks (ANNs) are not directly applicable to SNNs. Here, we propose an efficient Monte Carlo(MC)-dropout based approach for uncertainty estimation in SNNs. Our approach exploits the time-step mechanism of SNNs to enable MC-dropout in a computationally efficient manner, without introducing significant overheads during training and inference while demonstrating high accuracy and uncertainty quality.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesDecision MakingMedical DiagnosisSimilar Papers 제목 키워드 기반
Dropout Prediction Uncertainty Estimation Using Neuron Activation Strength
Dropout has been commonly used to quantify prediction uncertainty, i.e, the variations of model predictions on a given input example. However, using dropout in practice can be expensive as it requires running dropout inf…
PredictionEfficient Uncertainty Estimation for Semantic Segmentation in Videos
Uncertainty estimation in deep learning becomes more important recently. A deep learning model can't be applied in real applications if we don't know whether the model is certain about the decision or not. Some literatur…
Neuromorphic Acceleration for Approximate Bayesian Inference on Neural Networks via Permanent Dropout
As neural networks have begun performing increasingly critical tasks for society, ranging from driving cars to identifying candidates for drug development, the value of their ability to perform uncertainty quantification…
Bayesian InferenceUncertainty QuantificationContextual Dropout: An Efficient Sample-Dependent Dropout Module
Dropout has been demonstrated as a simple and effective module to not only regularize the training process of deep neural networks, but also provide the uncertainty estimation for prediction. However, the quality of unce…
image-classificationImage ClassificationQuestion AnsweringVisual Question Answering+1Rate-In: Information-Driven Adaptive Dropout Rates for Improved Inference-Time Uncertainty Estimation
Accurate uncertainty estimation is crucial for deploying neural networks in risk-sensitive applications such as medical diagnosis. Monte Carlo Dropout is a widely used technique for approximating predictive uncertainty b…
Medical Diagnosis