paper-with-me

홈 › Papers

SCCAM: Supervised Contrastive Convolutional Attention Mechanism for Ante-hoc Interpretable Fault Diagnosis with Limited Fault Samples

2023-02-03 · Mengxuan Li, Peng Peng, Jingxin Zhang, Hongwei Wang, Weiming Shen

In real industrial processes, fault diagnosis methods are required to learn from limited fault samples since the procedures are mainly under normal conditions and the faults rarely occur. Although attention mechanisms have become popular in the field of fault diagnosis, the existing attention-based methods are still unsatisfying for the above practical applications. First, pure attention-based architectures like transformers need a large number of fault samples to offset the lack of inductive biases thus performing poorly under limited fault samples. Moreover, the poor fault classification dilemma further leads to the failure of the existing attention-based methods to identify the root causes. To address the aforementioned issues, we innovatively propose a supervised contrastive convolutional attention mechanism (SCCAM) with ante-hoc interpretability, which solves the root cause analysis problem under limited fault samples for the first time. The proposed SCCAM method is tested on a continuous stirred tank heater and the Tennessee Eastman industrial process benchmark. Three common fault diagnosis scenarios are covered, including a balanced scenario for additional verification and two scenarios with limited fault samples (i.e., imbalanced scenario and long-tail scenario). The comprehensive results demonstrate that the proposed SCCAM method can achieve better performance compared with the state-of-the-art methods on fault classification and root cause analysis.

📄 PDF Abstract BibTeX arXiv:2302.01599

Code (0)

등록된 구현이 없습니다.

Tasks

Fault Diagnosis

Similar Papers 제목 키워드 기반

R-LAtte: Attention Module for Visual Control via Reinforcement Learning

2021-01-01 · Mandi Zhao, Qiyang Li, Aravind Srinivas, Ignasi Clavera 외

Attention mechanisms are generic inductive biases that have played a critical role in improving the state-of-the-art in supervised learning, unsupervised pre-training and generative modeling for multiple domains includin…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)Unsupervised Pre-training

Learning Self-Supervised Audio-Visual Representations for Sound Recommendations

2024-12-10 · Sudha Krishnamurthy

We propose a novel self-supervised approach for learning audio and visual representations from unlabeled videos, based on their correspondence. The approach uses an attention mechanism to learn the relative importance of…

Contrastive Learning

IDEAL: Improved DEnse locAL Contrastive Learning for Semi-Supervised Medical Image Segmentation

2022-10-26 · Hritam Basak, Soumitri Chattopadhyay, Rohit Kundu, Sayan Nag 외

Due to the scarcity of labeled data, Contrastive Self-Supervised Learning (SSL) frameworks have lately shown great potential in several medical image analysis tasks. However, the existing contrastive mechanisms are sub-o…

Contrastive LearningImage SegmentationMedical Image AnalysisMedical Image Segmentation+6

Discriminative Speaker Representation via Contrastive Learning with Class-Aware Attention in Angular Space

2022-10-29 · Zhe Li, Man-Wai Mak, Helen Mei-Ling Meng

The challenges in applying contrastive learning to speaker verification (SV) are that the softmax-based contrastive loss lacks discriminative power and that the hard negative pairs can easily influence learning. To overc…

Contrastive LearningSpeaker Verification

Wiener Graph Deconvolutional Network Improves Graph Self-Supervised Learning

2022-06-26 · Jiashun Cheng, Man Li, Jia Li, Fugee Tsung

Graph self-supervised learning (SSL) has been vastly employed to learn representations from unlabeled graphs. Existing methods can be roughly divided into predictive learning and contrastive learning, where the latter on…

Contrastive LearningDecoderSelf-Supervised Learning