paper-with-me

홈 › Papers

Knowledge Distillation and Enhanced Subdomain Adaptation Using Graph Convolutional Network for Resource-Constrained Bearing Fault Diagnosis

2025-01-13 · Mohammadreza Kavianpour, Parisa Kavianpour, Amin Ramezani, Mohammad TH Beheshti

Bearing fault diagnosis under varying working conditions faces challenges, including a lack of labeled data, distribution discrepancies, and resource constraints. To address these issues, we propose a progressive knowledge distillation framework that transfers knowledge from a complex teacher model, utilizing a Graph Convolutional Network (GCN) with Autoregressive moving average (ARMA) filters, to a compact and efficient student model. To mitigate distribution discrepancies and labeling uncertainty, we introduce Enhanced Local Maximum Mean Squared Discrepancy (ELMMSD), which leverages mean and variance statistics in the Reproducing Kernel Hilbert Space (RKHS) and incorporates a priori probability distributions between labels. This approach increases the distance between clustering centers, bridges subdomain gaps, and enhances subdomain alignment reliability. Experimental results on benchmark datasets (CWRU and JNU) demonstrate that the proposed method achieves superior diagnostic accuracy while significantly reducing computational costs. Comprehensive ablation studies validate the effectiveness of each component, highlighting the robustness and adaptability of the approach across diverse working conditions.

📄 PDF Abstract BibTeX arXiv:2501.07173

Code (0)

등록된 구현이 없습니다.

Tasks

DiagnosticFault DiagnosisKnowledge DistillationSubdomain adaptation

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Divide to Adapt: Mitigating Confirmation Bias for Domain Adaptation of Black-Box Predictors

2022-05-28 · Jianfei Yang, Xiangyu Peng, Kai Wang, Zheng Zhu 외

Domain Adaptation of Black-box Predictors (DABP) aims to learn a model on an unlabeled target domain supervised by a black-box predictor trained on a source domain. It does not require access to both the source-domain da…

Domain AdaptationKnowledge Distillation

Spatial Graph Convolutional Neural Network via Structured Subdomain Adaptation and Domain Adversarial Learning for Bearing Fault Diagnosis

2021-12-11 · Mohammadreza Ghorvei, Mohammadreza Kavianpour, Mohammad TH Beheshti, Amin Ramezani

Unsupervised domain adaptation (UDA) has shown remarkable results in bearing fault diagnosis under changing working conditions in recent years. However, most UDA methods do not consider the geometric structure of the dat…

Domain AdaptationFault DiagnosisSubdomain adaptationUnsupervised Domain Adaptation

ML-BPM: Multi-teacher Learning with Bidirectional Photometric Mixing for Open Compound Domain Adaptation in Semantic Segmentation

2022-07-19 · Fei Pan, Sungsu Hur, Seokju Lee, Junsik Kim 외

Open compound domain adaptation (OCDA) considers the target domain as the compound of multiple unknown homogeneous subdomains. The goal of OCDA is to minimize the domain gap between the labeled source domain and the unla…

Domain AdaptationSemantic Segmentation

Knowledge-inspired Subdomain Adaptation for Cross-Domain Knowledge Transfer

2023-08-17 · Liyue Chen, Linian Wang, Jinyu Xu, Shuai Chen 외

Most state-of-the-art deep domain adaptation techniques align source and target samples in a global fashion. That is, after alignment, each source sample is expected to become similar to any target sample. However, globa…

Domain AdaptationFraud DetectionSubdomain adaptationTransfer Learning

Speed-enhanced Subdomain Adaptation Regression for Long-term Stable Neural Decoding in Brain-computer Interfaces

2024-07-25 · Jiyu Wei, Dazhong Rong, Xinyun Zhu, Qinming He 외

Brain-computer interfaces (BCIs) offer a means to convert neural signals into control signals, providing a potential restoration of movement for people with paralysis. Despite their promise, BCIs face a significant chall…

Contrastive LearningDomain AdaptationregressionSubdomain adaptation