paper-with-me

홈 › Papers

Spectral Aliasing Pretext: A novel task for Self-Supervised fault diagnosis in rotating machinery

2026-08-06 · Victor Gialis, Maxime Metz, David Esteve, Abdenour Soualhi arxiv

Deep learning is a new way for machinery fault diagnosis but requires extensive labeled data, a scarce resource in industrial settings. We propose Spectral Aliasing Pretext (SAP), a self-supervised learning method that pretrains models on unlabeled vibration data by exploiting spectral aliasing. We deliberately undersample signals to create folded spectrum, then train a Transformer to reconstruct the original unfolded spectrum. This pretext task forces the model to learn frequency-domain invariants characteristic of mechanical faults, without potentially destructive augmentations. Experiments on the CWRU dataset show that SAP learns stable and highly discriminative representations. In a linear probing setting, SAP quickly achieves very high classification performance with only a small fraction of labeled data and low variance. In contrast, full fine-tuning, including fully supervised training, does not lead to more stable or better results. Overall, these findings suggest that SAP combined with linear probing can be more effective and reliable than fully supervised training for fault diagnosis with limited labeled data.

📄 PDF Abstract BibTeX arXiv:2608.05705

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised LearningFault Diagnosis

Similar Papers 제목 키워드 기반

Hyperspectral Anomaly Detection with Self-Supervised Anomaly Prior

2024-04-20 · Yidan Liu, Weiying Xie, Kai Jiang, Jiaqing Zhang 외

The majority of existing hyperspectral anomaly detection (HAD) methods use the low-rank representation (LRR) model to separate the background and anomaly components, where the anomaly component is optimized by handcrafte…

Anomaly DetectionSelf-Supervised Learning

A generic self-supervised learning (SSL) framework for representation learning from spectra-spatial feature of unlabeled remote sensing imagery

2023-06-27 · Xin Zhang, Liangxiu Han

Remote sensing data has been widely used for various Earth Observation (EO) missions such as land use and cover classification, weather forecasting, agricultural management, and environmental monitoring. Most existing re…

Earth ObservationInductive BiasLand Cover ClassificationRepresentation Learning+2

Self-Supervised Learning of Pretext-Invariant Representations

2019-12-04 · CVPR 2020 6 · Ishan Misra, Laurens van der Maaten

The goal of self-supervised learning from images is to construct image representations that are semantically meaningful via pretext tasks that do not require semantic annotations for a large training set of images. Many …

Contrastive Learningobject-detectionObject DetectionRepresentation Learning+3

SpecBPP: A Self-Supervised Learning Approach for Hyperspectral Representation and Soil Organic Carbon Estimation

2025-07-26 · Daniel La'ah Ayuba, Jean-Yves Guillemaut, Belen Marti-Cardona, Oscar Mendez Maldonado arxiv

Self-supervised learning has revolutionized representation learning in vision and language, but remains underexplored for hyperspectral imagery (HSI), where the sequential structure of spectral bands offers unique opport…

Self-Supervised LearningRepresentation Learning

Pretext Tasks selection for multitask self-supervised speech representation learning

2021-07-01 · Salah Zaiem, Titouan Parcollet, Slim Essid, Abdel Heba

Through solving pretext tasks, self-supervised learning leverages unlabeled data to extract useful latent representations replacing traditional input features in the downstream task. In audio/speech signal processing, a …

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Emotion RecognitionRepresentation Learning+5