A class-weighted supervised contrastive learning long-tailed bearing fault diagnosis approach using quadratic neural network
Deep learning has achieved remarkable success in bearing fault diagnosis. However, its performance oftentimes deteriorates when dealing with highly imbalanced or long-tailed data, while such cases are prevalent in industrial settings because fault is a rare event that occurs with an extremely low probability. Conventional data augmentation methods face fundamental limitations due to the scarcity of samples pertaining to the minority class. In this paper, we propose a supervised contrastive learning approach with a class-aware loss function to enhance the feature extraction capability of neural networks for fault diagnosis. The developed class-weighted contrastive learning quadratic network (CCQNet) consists of a quadratic convolutional residual network backbone, a contrastive learning branch utilizing a class-weighted contrastive loss, and a classifier branch employing logit-adjusted cross-entropy loss. By utilizing class-weighted contrastive loss and logit-adjusted cross-entropy loss, our approach encourages equidistant representation of class features, thereby inducing equal attention on all the classes. We further analyze the superior feature extraction ability of quadratic network by establishing the connection between quadratic neurons and autocorrelation in signal processing. Experimental results on public and proprietary datasets are used to validate the effectiveness of CCQNet, and computational results reveal that CCQNet outperforms SOTA methods in handling extremely imbalanced data substantially.
Code (1)
Tasks
Contrastive LearningData AugmentationFault DiagnosisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ECL: Class-Enhancement Contrastive Learning for Long-tailed Skin Lesion Classification
Skin image datasets often suffer from imbalanced data distribution, exacerbating the difficulty of computer-aided skin disease diagnosis. Some recent works exploit supervised contrastive learning (SCL) for this long-tail…
Contrastive LearningLesion ClassificationSkin Lesion ClassificationContrastive Learning based Hybrid Networks for Long-Tailed Image Classification
Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning h…
ClassificationContrastive LearningGeneral Classificationimage-classification+3Supervised Contrastive Learning on Blended Images for Long-tailed Recognition
Real-world data often have a long-tailed distribution, where the number of samples per class is not equal over training classes. The imbalanced data form a biased feature space, which deteriorates the performance of the …
Contrastive LearningData AugmentationLong-tail LearningDistribution-Aware Robust Learning from Long-Tailed Data with Noisy Labels
Deep neural networks have demonstrated remarkable advancements in various fields using large, well-annotated datasets. However, real-world data often exhibit long-tailed distributions and label noise, significantly degra…
Contrastive LearningTargeted Supervised Contrastive Learning for Long-Tailed Recognition
Real-world data often exhibits long tail distributions with heavy class imbalance, where the majority classes can dominate the training process and alter the decision boundaries of the minority classes. Recently, researc…
Contrastive LearningLong-tail Learning