paper-with-me

홈 › Papers

An Anomaly Detection Method for Satellites Using Monte Carlo Dropout

2022-11-27 · Mohammad Amin Maleki Sadr, Yeying Zhu, Peng Hu

Recently, there has been a significant amount of interest in satellite telemetry anomaly detection (AD) using neural networks (NN). For AD purposes, the current approaches focus on either forecasting or reconstruction of the time series, and they cannot measure the level of reliability or the probability of correct detection. Although the Bayesian neural network (BNN)-based approaches are well known for time series uncertainty estimation, they are computationally intractable. In this paper, we present a tractable approximation for BNN based on the Monte Carlo (MC) dropout method for capturing the uncertainty in the satellite telemetry time series, without sacrificing accuracy. For time series forecasting, we employ an NN, which consists of several Long Short-Term Memory (LSTM) layers followed by various dense layers. We employ the MC dropout inside each LSTM layer and before the dense layers for uncertainty estimation. With the proposed uncertainty region and by utilizing a post-processing filter, we can effectively capture the anomaly points. Numerical results show that our proposed time series AD approach outperforms the existing methods from both prediction accuracy and AD perspectives.

📄 PDF Abstract BibTeX arXiv:2211.14938

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionTime SeriesTime Series AnalysisTime Series Forecasting

Methods 이 논문이 사용한 방법론

Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

How Certain is Your Transformer?

2021-04-01 · EACL 2021 2 · Artem Shelmanov, Evgenii Tsymbalov, Dmitri Puzyrev, Kirill Fedyanin 외

In this work, we consider the problem of uncertainty estimation for Transformer-based models. We investigate the applicability of uncertainty estimates based on dropout usage at the inference stage (Monte Carlo dropout).…

Natural Language UnderstandingPoint Processes

Prior Networks for Detection of Adversarial Attacks

2018-12-06 · Andrey Malinin, Mark Gales

Adversarial examples are considered a serious issue for safety critical applications of AI, such as finance, autonomous vehicle control and medicinal applications. Though significant work has resulted in increased robust…

Adversarial AttackAdversarial Attack Detection

Uncertainty Quantification in Alzheimer's Disease Progression Modeling

2024-08-13 · Wael Mobeirek, Shirley Mao

With the increasing number of patients diagnosed with Alzheimer's Disease, prognosis models have the potential to aid in early disease detection. However, current approaches raise dependability concerns as they do not ac…

Ensemble LearningPrognosisUncertainty QuantificationVariational Inference

Multi-level Monte Carlo Dropout for Efficient Uncertainty Quantification

2026-01-19 · Aaron Pim, Tristan Pryer arxiv

We develop a multilevel Monte Carlo (MLMC) framework for uncertainty quantification with Monte Carlo dropout. Treating dropout masks as a source of epistemic randomness, we define a fidelity hierarchy by the number of st…

Qualitative Analysis of Monte Carlo Dropout

2020-07-03 · Ronald Seoh

In this report, we present qualitative analysis of Monte Carlo (MC) dropout method for measuring model uncertainty in neural network (NN) models. We first consider the sources of uncertainty in NNs, and briefly review Ba…