paper-with-me

홈 › Papers

Friend or Foe? Harnessing Controllable Overfitting for Anomaly Detection

2024-11-30 · Long Qian, Bingke Zhu, Yingying Chen, Ming Tang, Jinqiao Wang

Overfitting has long been stigmatized as detrimental to model performance, especially in the context of anomaly detection. Our work challenges this conventional view by introducing a paradigm shift, recasting overfitting as a controllable and strategic mechanism for enhancing model discrimination capabilities. In this paper, we present Controllable Overfitting-based Anomaly Detection (COAD), a novel framework designed to leverage overfitting for optimized anomaly detection. We propose the Aberrance Retention Quotient (ARQ), a novel metric that systematically quantifies the extent of overfitting, enabling the identification of an optimal "golden overfitting interval." Within this interval, overfitting is leveraged to significantly amplify the model's sensitivity to anomalous patterns, while preserving generalization to normal samples. Additionally, we present the Relative Anomaly Distribution Index (RADI), an innovative metric designed to complement AUROC pixel by providing a more versatile and theoretically robust framework for assessing model performance. RADI leverages ARQ to track and evaluate how overfitting impacts anomaly detection, offering an integrated approach to understanding the relationship between overfitting dynamics and model efficacy. Our theoretical work also rigorously validates the use of Gaussian noise in pseudo anomaly synthesis, providing the foundation for its broader applicability across diverse domains. Empirical evaluations demonstrate that our controllable overfitting method not only achieves State of the Art (SOTA) performance in both one-class and multi-class anomaly detection tasks but also redefines overfitting from a modeling challenge into a powerful tool for optimizing anomaly detection.

📄 PDF Abstract BibTeX arXiv:2412.00560

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionMulti-class Anomaly Detection

Similar Papers 제목 키워드 기반

Harnessing Sequence Labeling for Sarcasm Detection in Dialogue from TV Series `Friends'

2016-08-01 · CONLL 2016 8 · Aditya Joshi, Vaibhav Tripathi, Pushpak Bhattacharyya, Mark J. Carman
Sarcasm DetectionSentiment Analysis

ADA-GAD: Anomaly-Denoised Autoencoders for Graph Anomaly Detection

2023-12-22 · Junwei He, Qianqian Xu, Yangbangyan Jiang, Zitai Wang 외

Graph anomaly detection is crucial for identifying nodes that deviate from regular behavior within graphs, benefiting various domains such as fraud detection and social network. Although existing reconstruction-based met…

Anomaly DetectionFraud DetectionGraph Anomaly Detection

LARA: A Light and Anti-overfitting Retraining Approach for Unsupervised Time Series Anomaly Detection

2023-10-09 · Feiyi Chen, Zhen Qin, Yingying Zhang, Shuiguang Deng 외

Most of current anomaly detection models assume that the normal pattern remains same all the time. However, the normal patterns of Web services change dramatically and frequently. The model trained on old-distribution da…

Anomaly DetectionTime SeriesTime Series Anomaly DetectionUnsupervised Anomaly Detection

Harnessing Feature Clustering For Enhanced Anomaly Detection With Variational Autoencoder And Dynamic Threshold

2024-07-14 · Tolulope Ale, Nicole-Jeanne Schlegel, Vandana P. Janeja

We introduce an anomaly detection method for multivariate time series data with the aim of identifying critical periods and features influencing extreme climate events like snowmelt in the Arctic. This method leverages t…

Anomaly DetectionClusteringTime Series

Modeling Quantum Federated Autoencoder for Anomaly Detection in IoT Networks

2026-03-23 · Devashish Chaudhary, Sutharshan Rajasegarar, Shiva Raj Pokhrel arxiv

We propose a Quantum Federated Autoencoder for Anomaly Detection, a framework that leverages quantum federated learning for efficient, secure, and distributed processing in IoT networks. By harnessing quantum autoencoder…

Federated LearningAnomaly Detection