Self-degraded contrastive domain adaptation for industrial fault diagnosis with bi-imbalanced data
Modern industrial fault diagnosis tasks often face the combined challenge of distribution discrepancy and bi-imbalance. Existing domain adaptation approaches pay little attention to the prevailing bi-imbalance, leading to poor domain adaptation performance or even negative transfer. In this work, we propose a self-degraded contrastive domain adaptation (Sd-CDA) diagnosis framework to handle the domain discrepancy under the bi-imbalanced data. It first pre-trains the feature extractor via imbalance-aware contrastive learning based on model pruning to learn the feature representation efficiently in a self-supervised manner. Then it forces the samples away from the domain boundary based on supervised contrastive domain adversarial learning (SupCon-DA) and ensures the features generated by the feature extractor are discriminative enough. Furthermore, we propose the pruned contrastive domain adversarial learning (PSupCon-DA) to pay automatically re-weighted attention to the minorities to enhance the performance towards bi-imbalanced data. We show the superiority of the proposed method via two experiments.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningDomain AdaptationFault DiagnosisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unsupervised Hierarchical Domain Adaptation for Adverse Weather Optical Flow
Optical flow estimation has made great progress, but usually suffers from degradation under adverse weather. Although semi/full-supervised methods have made good attempts, the domain shift between the synthetic and real …
Domain AdaptationOptical Flow EstimationAdverse Weather Optical Flow: Cumulative Homogeneous-Heterogeneous Adaptation
Optical flow has made great progress in clean scenes, while suffers degradation under adverse weather due to the violation of the brightness constancy and gradient continuity assumptions of optical flow. Typically, exist…
Domain AdaptationKnowledge DistillationOptical Flow EstimationQA Domain Adaptation using Hidden Space Augmentation and Self-Supervised Contrastive Adaptation
Question answering (QA) has recently shown impressive results for answering questions from customized domains. Yet, a common challenge is to adapt QA models to an unseen target domain. In this paper, we propose a novel s…
Contrastive LearningData AugmentationDomain AdaptationQuestion AnsweringBridging Contrastive Learning and Domain Adaptation: Theoretical Perspective and Practical Application
This work studies the relationship between Contrastive Learning and Domain Adaptation from a theoretical perspective. The two standard contrastive losses, NT-Xent loss (Self-supervised) and Supervised Contrastive loss, a…
Contrastive LearningDomain AdaptationIs Domain Adaptation Always Helpful? A Frozen-Backbone Study of Cross-Domain Sentiment Transfer
Sentiment analysis with frozen pre-trained language model (PLM) backbones has become a common paradigm, yet the practical benefit of explicit domain adaptation remains unclear, particularly when backbones encode varying …
Contrastive LearningSentiment AnalysisDomain Adaptation