paper-with-me

홈 › Papers

TSViT: A Time Series Vision Transformer for Fault Diagnosis

2023-11-12 · Shouhua Zhang, Jiehan Zhou, Xue Ma, Susanna Pirttikangas, Chunsheng Yang

Traditional fault diagnosis methods using Convolutional Neural Networks (CNNs) often struggle with capturing the temporal dynamics of vibration signals. To overcome this, the application of Transformer-based Vision Transformer (ViT) methods to fault diagnosis is gaining attraction. Nonetheless, these methods typically require extensive preprocessing, which increases computational complexity, potentially reducing the efficiency of the diagnosis process. Addressing this gap, this paper presents the Time Series Vision Transformer (TSViT), tailored for effective fault diagnosis. TSViT incorporates a convolutional layer to extract local features from vibration signals, alongside a transformer encoder to discern long-term temporal patterns. A thorough experimental comparison on three diverse datasets demonstrates TSViT's effectiveness and adaptability. Moreover, the paper delves into the influence of hyperparameter tuning on the model's performance, computational demand, and parameter count. Remarkably, TSViT achieves an unprecedented 100% average accuracy on two test sets and 99.99% on another, showcasing its exceptional diagnostic capabilities.

📄 PDF Abstract BibTeX arXiv:2311.06916

Code (0)

등록된 구현이 없습니다.

Tasks

DiagnosticFault DiagnosisTime Series

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

ViTs for SITS: Vision Transformers for Satellite Image Time Series

2023-01-12 · CVPR 2023 1 · Michail Tarasiou, Erik Chavez, Stefanos Zafeiriou

In this paper we introduce the Temporo-Spatial Vision Transformer (TSViT), a fully-attentional model for general Satellite Image Time Series (SITS) processing based on the Vision Transformer (ViT). TSViT splits a SITS re…

Semantic SegmentationTime SeriesTime Series Analysis

Multi-Modal Vision Transformers for Crop Mapping from Satellite Image Time Series

2024-06-24 · Theresa Follath, David Mickisch, Jan Hemmerling, Stefan Erasmi 외

Using images acquired by different satellite sensors has shown to improve classification performance in the framework of crop mapping from satellite image time series (SITS). Existing state-of-the-art architectures use s…

Time Series

The role of spatial context and multitask learning in the detection of organic and conventional farming systems based on Sentinel-2 time series

2026-03-25 · Jan Hemmerling, Marcel Schwieder, Philippe Rufin, Leon-Friedrich Thomas 외 arxiv

Organic farming is a key element in achieving more sustainable agriculture. For a better understanding of the development and impact of organic farming, comprehensive, spatially explicit information is needed. This study…

Detection and Classification of Internal Faults in Power Transformers using Tree-based Classifiers

2020-05-28 · Samita Rani Pani, Pallav Kumar Bera, Vajendra Kumar

This paper proposes a Decision Tree (DT) based detection and classification of internal faults in a power transformer. The faults are simulated in Power System Computer Aided Design (PSCAD)/ Electromagnetic Transients in…

General Classification

Is it Time to Replace CNNs with Transformers for Medical Images?

2021-08-20 · Christos Matsoukas, Johan Fredin Haslum, Magnus Söderberg, Kevin Smith

Convolutional Neural Networks (CNNs) have reigned for a decade as the de facto approach to automated medical image diagnosis. Recently, vision transformers (ViTs) have appeared as a competitive alternative to CNNs, yield…