paper-with-me

홈 › Papers

Attention-embedded Quadratic Network (Qttention) for Effective and Interpretable Bearing Fault Diagnosis

2022-06-01 · Jing-Xiao Liao, Hang-Cheng Dong, Zhi-Qi Sun, Jinwei Sun, Shiping Zhang, Feng-Lei Fan

Bearing fault diagnosis is of great importance to decrease the damage risk of rotating machines and further improve economic profits. Recently, machine learning, represented by deep learning, has made great progress in bearing fault diagnosis. However, applying deep learning to such a task still faces a major problem. A deep network is notoriously a black box. It is difficult to know how a model classifies faulty signals from the normal and the physics principle behind the classification. To solve the interpretability issue, first, we prototype a convolutional network with recently-invented quadratic neurons. This quadratic neuron empowered network can qualify the noisy bearing data due to the strong feature representation ability of quadratic neurons. Moreover, we independently derive the attention mechanism from a quadratic neuron, referred to as qttention, by factorizing the learned quadratic function in analogue to the attention, making the model with quadratic neurons inherently interpretable. Experiments on the public and our datasets demonstrate that the proposed network can facilitate effective and interpretable bearing fault diagnosis.

📄 PDF Abstract BibTeX arXiv:2206.00390

Code (1)

asdvfghg/QCNN_for_bearing_diagnosis 공식 구현 pytorch

Tasks

Fault Diagnosis

Similar Papers 제목 키워드 기반

Graph Laplacian Wavelet Transformer via Learnable Spectral Decomposition

2025-05-09 · Andrew Kiruluta, Eric Lundy, Priscilla Burity

Existing sequence to sequence models for structured language tasks rely heavily on the dot product self attention mechanism, which incurs quadratic complexity in both computation and memory for input length N. We introdu…

Disentangled Interpretable Representation for Efficient Long-term Time Series Forecasting

2024-11-26 · Yuang Zhao, Tianyu Li, Jiadong Chen, Shenrong Ye 외

Industry 5.0 introduces new challenges for Long-term Time Series Forecasting (LTSF), characterized by high-dimensional, high-resolution data and high-stakes application scenarios. Against this backdrop, developing effici…

Multivariate Time Series ForecastingTime SeriesTime Series Forecasting

PaCa-ViT: Learning Patch-to-Cluster Attention in Vision Transformers

2022-03-22 · CVPR 2023 1 · Ryan Grainger, Thomas Paniagua, Xi Song, Naresh Cuntoor 외

Vision Transformers (ViTs) are built on the assumption of treating image patches as ``visual tokens" and learn patch-to-patch attention. The patch embedding based tokenizer has a semantic gap with respect to its counterp…

Clusteringimage-classificationImage ClassificationInstance Segmentation+4

A Sparse Cross Attention-based Graph Convolution Network with Auxiliary Information Awareness for Traffic Flow Prediction

2023-12-14 · Lingqiang Chen, Qinglin Zhao, Guanghui Li, Mengchu Zhou 외

Deep graph convolution networks (GCNs) have recently shown excellent performance in traffic prediction tasks. However, they face some challenges. First, few existing models consider the influence of auxiliary information…

AttributeDecoderGPUTraffic Prediction

SEA: Sparse Linear Attention with Estimated Attention Mask

2023-10-03 · Heejun Lee, Jina Kim, Jeffrey Willette, Sung Ju Hwang

The transformer architecture has driven breakthroughs in recent years on tasks which require modeling pairwise relationships between sequential elements, as is the case in natural language understanding. However, long se…

Knowledge DistillationLanguage ModelingLanguage ModellingNatural Language Understanding