paper-with-me

홈 › Papers

LARA: A Light and Anti-overfitting Retraining Approach for Unsupervised Time Series Anomaly Detection

2023-10-09 · Feiyi Chen, Zhen Qin, Yingying Zhang, Shuiguang Deng, Yi Xiao, Guansong Pang, Qingsong Wen

Most of current anomaly detection models assume that the normal pattern remains same all the time. However, the normal patterns of Web services change dramatically and frequently. The model trained on old-distribution data is outdated after such changes. Retraining the whole model every time is expensive. Besides, at the beginning of normal pattern changes, there is not enough observation data from the new distribution. Retraining a large neural network model with limited data is vulnerable to overfitting. Thus, we propose a Light and Anti-overfitting Retraining Approach (LARA) for deep variational auto-encoder based time series anomaly detection methods (VAEs). This work aims to make three novel contributions: 1) the retraining process is formulated as a convex problem and can converge at a fast rate as well as prevent overfitting; 2) designing a ruminate block, which leverages the historical data without the need to store them; 3) mathematically proving that when fine-tuning the latent vector and reconstructed data, the linear formations can achieve the least adjusting errors between the ground truths and the fine-tuned ones. Moreover, we have performed many experiments to verify that retraining LARA with even 43 time slots of data from new distribution can result in its competitive F1 Score in comparison with the state-of-the-art anomaly detection models trained with sufficient data. Besides, we verify its light overhead.

📄 PDF Abstract BibTeX arXiv:2310.05668

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionTime SeriesTime Series Anomaly DetectionUnsupervised Anomaly Detection

Similar Papers 제목 키워드 기반

Unsupervised Declarative Knowledge Induction for Constraint-Based Learning of Information Structure in Scientific Documents

2015-01-01 · TACL 2015 1 · Yufan Guo, Roi Reichart, Anna Korhonen

Inferring the information structure of scientific documents is useful for many NLP applications. Existing approaches to this task require substantial human effort. We propose a framework for constraint learning that redu…

Topic Models

Mitigating Overfitting in Medical Imaging: Self-Supervised Pretraining vs. ImageNet Transfer Learning for Dermatological Diagnosis

2025-05-22 · Iván Matas, Carmen Serrano, Miguel Nogales, David Moreno 외

Deep learning has transformed computer vision but relies heavily on large labeled datasets and computational resources. Transfer learning, particularly fine-tuning pretrained models, offers a practical alternative; howev…

Self-Supervised LearningTransfer Learning

Improving Unsupervised Question Answering via Summarization-Informed Question Generation

2021-09-16 · EMNLP 2021 11 · Chenyang Lyu, Lifeng Shang, Yvette Graham, Jennifer Foster 외

Question Generation (QG) is the task of generating a plausible question for a given <passage, answer> pair. Template-based QG uses linguistically-informed heuristics to transform declarative sentences into interrogatives…

ArticlesDependency Parsingnamed-entity-recognitionNamed Entity Recognition+7

Best of Both Worlds: A Pliable and Generalizable Neuro-Symbolic Approach for Relation Classification

2024-03-05 · Robert Vacareanu, Fahmida Alam, Md Asiful Islam, Haris Riaz 외

This paper introduces a novel neuro-symbolic architecture for relation classification (RC) that combines rule-based methods with contemporary deep learning techniques. This approach capitalizes on the strengths of both p…

Few-Shot Relation ClassificationRelationRelation ClassificationSemantic Text Matching+1

LARA: Linguistic-Adaptive Retrieval-Augmentation for Multi-Turn Intent Classification

2024-03-25 · Junhua Liu, Yong Keat Tan, Bin Fu, Kwan Hui Lim

Multi-turn intent classification is notably challenging due to the complexity and evolving nature of conversational contexts. This paper introduces LARA, a Linguistic-Adaptive Retrieval-Augmentation framework to enhance …

ChatbotClassificationIn-Context Learningintent-classification+4