paper-with-me

홈 › Papers

Towards Automated Self-Supervised Learning for Truly Unsupervised Graph Anomaly Detection

2025-01-24 · Zhong Li, Yuhang Wang, Matthijs van Leeuwen

Self-supervised learning (SSL) is an emerging paradigm that exploits supervisory signals generated from the data itself, and many recent studies have leveraged SSL to conduct graph anomaly detection. However, we empirically found that three important factors can substantially impact detection performance across datasets: 1) the specific SSL strategy employed; 2) the tuning of the strategy's hyperparameters; and 3) the allocation of combination weights when using multiple strategies. Most SSL-based graph anomaly detection methods circumvent these issues by arbitrarily or selectively (i.e., guided by label information) choosing SSL strategies, hyperparameter settings, and combination weights. While an arbitrary choice may lead to subpar performance, using label information in an unsupervised setting is label information leakage and leads to severe overestimation of a method's performance. Leakage has been criticized as "one of the top ten data mining mistakes", yet many recent studies on SSL-based graph anomaly detection have been using label information to select hyperparameters. To mitigate this issue, we propose to use an internal evaluation strategy (with theoretical analysis) to select hyperparameters in SSL for unsupervised anomaly detection. We perform extensive experiments using 10 recent SSL-based graph anomaly detection algorithms on various benchmark datasets, demonstrating both the prior issues with hyperparameter selection and the effectiveness of our proposed strategy.

📄 PDF Abstract BibTeX arXiv:2501.14694

Code (1)

zhonglifr/autogad2024 공식 구현 pytorch

Tasks

Anomaly DetectionGraph Anomaly DetectionSelf-Supervised LearningUnsupervised Anomaly Detection

Similar Papers 제목 키워드 기반

Towards Truly Unsupervised Evaluation of Feature Selection

2026-08-12 · Hafiz Saud Arshad, Muhammad Rajabinasab, Arthur Zimek arxiv

Feature selection is one of the most important and fundamental tasks in data mining, tackled by a family of methods with an established set of evaluation techniques to measure the quality of a specific method. Most of th…

SCPNet: Unsupervised Cross-modal Homography Estimation via Intra-modal Self-supervised Learning

2024-07-11 · Runmin Zhang, Jun Ma, Si-Yuan Cao, Lun Luo 외

We propose a novel unsupervised cross-modal homography estimation framework based on intra-modal Self-supervised learning, Correlation, and consistent feature map Projection, namely SCPNet. The concept of intra-modal sel…

Homography EstimationSelf-Supervised Learning

Off-the-Shelf Unsupervised NMT

2018-11-06 · Chris Hokamp, Sebastian Ruder, John Glover

We frame unsupervised machine translation (MT) in the context of multi-task learning (MTL), combining insights from both directions. We leverage off-the-shelf neural MT architectures to train unsupervised MT models with …

Machine TranslationMulti-Task LearningNMTTranslation+1

Foundation Policies with Hilbert Representations

2024-02-23 · Seohong Park, Tobias Kreiman, Sergey Levine

Unsupervised and self-supervised objectives, such as next token prediction, have enabled pre-training generalist models from large amounts of unlabeled data. In reinforcement learning (RL), however, finding a truly gener…

Reinforcement Learning (RL)Unsupervised Pre-training

Rethinking the Truly Unsupervised Image-to-Image Translation

2020-06-11 · ICCV 2021 10 · Kyungjune Baek, Yunjey Choi, Youngjung Uh, Jaejun Yoo 외

Every recent image-to-image translation model inherently requires either image-level (i.e. input-output pairs) or set-level (i.e. domain labels) supervision. However, even set-level supervision can be a severe bottleneck…

Image-to-Image TranslationTranslationUnsupervised Image-To-Image Translation