A novel time-frequency Transformer based on self-attention mechanism and its application in fault diagnosis of rolling bearings
The scope of data-driven fault diagnosis models is greatly extended through deep learning (DL). However, the classical convolution and recurrent structure have their defects in computational efficiency and feature representation, while the latest Transformer architecture based on attention mechanism has not yet been applied in this field. To solve these problems, we propose a novel time-frequency Transformer (TFT) model inspired by the massive success of vanilla Transformer in sequence processing. Specially, we design a fresh tokenizer and encoder module to extract effective abstractions from the time-frequency representation (TFR) of vibration signals. On this basis, a new end-to-end fault diagnosis framework based on time-frequency Transformer is presented in this paper. Through the case studies on bearing experimental datasets, we construct the optimal Transformer structure and verify its fault diagnosis performance. The superiority of the proposed method is demonstrated in comparison with the benchmark models and other state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyFault DiagnosisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SignGT: Signed Attention-based Graph Transformer for Graph Representation Learning
The emerging graph Transformers have achieved impressive performance for graph representation learning over graph neural networks (GNNs). In this work, we regard the self-attention mechanism, the core module of graph Tra…
Graph Representation LearningNode ClassificationRepresentation LearningLearning Spatiotemporal Frequency-Transformer for Low-Quality Video Super-Resolution
Video Super-Resolution (VSR) aims to restore high-resolution (HR) videos from low-resolution (LR) videos. Existing VSR techniques usually recover HR frames by extracting pertinent textures from nearby frames with known d…
Super-ResolutionVideo EnhancementVideo Super-ResolutionAutomatic Piano Transcription with Hierarchical Frequency-Time Transformer
Taking long-term spectral and temporal dependencies into account is essential for automatic piano transcription. This is especially helpful when determining the precise onset and offset for each note in the polyphonic pi…
DecoderMusic TranscriptionFAiT: Frequency-Aware Inverted Transformer for Multivariate Time Series Forecasting
While Transformer-based architectures have established themselves as a dominant paradigm in Multivariate Time Series Forecasting (MTSF), their core self-attention mechanism inherently functions as a low-pass filter, syst…
Multivariate Time Series ForecastingComputational EfficiencyFrequency-Aware Spatiotemporal Transformers for Video Inpainting Detection
In this paper, we propose a frequency-aware spatiotemporal transformers for deep In this paper, we propose a Frequency-Aware Spatiotemporal Transformer (FAST) for video inpainting detection, which aims to simultaneou…
DecoderVideo Inpainting