paper-with-me

Papers

Iterative Encoding-Decoding VAEs Anomaly Detection in NOAA's DART Time Series: A Machine Learning Approach for Enhancing Data Integrity for NASA's GRACE-FO Verification and Validation

2024-12-20 · Kevin Lee

NOAA's Deep-ocean Assessment and Reporting of Tsunamis (DART) data are critical for NASA-JPL's tsunami detection, real-time operations, and oceanographic research. However, these time-series data often contain spikes, steps, and drifts that degrade data quality and obscure essential oceanographic features. To address these anomalies, the work introduces an Iterative Encoding-Decoding Variational Autoencoders (Iterative Encoding-Decoding VAEs) model to improve the quality of DART time series. Unlike traditional filtering and thresholding methods that risk distorting inherent signal characteristics, Iterative Encoding-Decoding VAEs progressively remove anomalies while preserving the data's latent structure. A hybrid thresholding approach further retains genuine oceanographic features near boundaries. Applied to complex DART datasets, this approach yields reconstructions that better maintain key oceanic properties compared to classical statistical techniques, offering improved robustness against spike removal and subtle step changes. The resulting high-quality data supports critical verification and validation efforts for the GRACE-FO mission at NASA-JPL, where accurate surface measurements are essential to modeling Earth's gravitational field and global water dynamics. Ultimately, this data processing method enhances tsunami detection and underpins future climate modeling with improved interpretability and reliability.

📄 PDF Abstract BibTeX arXiv:2412.16375

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionTime Series

Methods 이 논문이 사용한 방법론

DART # 🎯 DART-Math > Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving 📝 Paper@arXiv | 🤗…

Similar Papers 제목 키워드 기반

Anomaly detection through latent space restoration using vector-quantized variational autoencoders

2020-12-12 · Sergio Naval Marimont, Giacomo Tarroni

We propose an out-of-distribution detection method that combines density and restoration-based approaches using Vector-Quantized Variational Auto-Encoders (VQ-VAEs). The VQ-VAE model learns to encode images in a categori…

Anomaly DetectionOut-of-Distribution DetectionUnsupervised Anomaly Detection

Multiple Instance-Based Video Anomaly Detection using Deep Temporal Encoding-Decoding

2020-07-03 · Ammar Mansoor Kamoona, Amirali Khodadadian Gosta, Alireza Bab-Hadiashar, Reza Hoseinnezhad

In this paper, we propose a weakly supervised deep temporal encoding-decoding solution for anomaly detection in surveillance videos using multiple instance learning. The proposed approach uses both abnormal and normal vi…

Anomaly DetectionAnomaly Detection In Surveillance VideosMultiple Instance LearningVideo Anomaly Detection

Improving unsupervised anomaly localization by applying multi-scale memories to autoencoders

2020-12-21 · Yifei Yang, Shibing Xiang, Ruixiang Zhang

Autoencoder and its variants have been widely applicated in anomaly detection.The previous work memory-augmented deep autoencoder proposed memorizing normality to detect anomaly, however it neglects the feature discrepan…

Anomaly DetectionAnomaly Localization

High- and Low-level image component decomposition using VAEs for improved reconstruction and anomaly detection

2019-11-27 · David Zimmerer, Jens Petersen, Klaus Maier-Hein

Variational Auto-Encoders have often been used for unsupervised pretraining, feature extraction and out-of-distribution and anomaly detection in the medical field. However, VAEs often lack the ability to produce sharp im…

Anomaly DetectionOut of Distribution (OOD) Detection

Image Anomaly Detection by Aggregating Deep Pyramidal Representations

2020-11-12 · Pankaj Mishra, Claudio Piciarelli, Gian Luca Foresti

Anomaly detection consists in identifying, within a dataset, those samples that significantly differ from the majority of the data, representing the normal class. It has many practical applications, e.g. ranging from def…

Anomaly Detection