paper-with-me

Papers

Learning to better see the unseen: Broad-Deep Mixed Anti-Forgetting Framework for Incremental Zero-Shot Fault Diagnosis

2024-03-18 · Jiancheng Zhao, Jiaqi Yue, Chunhui Zhao

Zero-shot fault diagnosis (ZSFD) is capable of identifying unseen faults via predicting fault attributes labeled by human experts. We first recognize the demand of ZSFD to deal with continuous changes in industrial processes, i.e., the model's ability to adapt to new fault categories and attributes while avoiding forgetting the diagnosis ability learned previously. To overcome the issue that the existing ZSFD paradigm cannot learn from evolving streams of training data in industrial scenarios, the incremental ZSFD (IZSFD) paradigm is proposed for the first time, which incorporates category increment and attribute increment for both traditional ZSFD and generalized ZSFD paradigms. To achieve IZSFD, we present a broad-deep mixed anti-forgetting framework (BDMAFF) that aims to learn from new fault categories and attributes. To tackle the issue of forgetting, BDMAFF effectively accumulates previously acquired knowledge from two perspectives: features and attribute prototypes. The feature memory is established through a deep generative model that employs anti-forgetting training strategies, ensuring the generation quality of historical categories is supervised and maintained. The diagnosis model SEEs the UNSEEN faults with the help of generated samples from the generative model. The attribute prototype memory is established through a diagnosis model inspired by the broad learning system. Unlike traditional incremental learning algorithms, BDMAFF introduces a memory-driven iterative update strategy for the diagnosis model, which allows the model to learn new faults and attributes without requiring the storage of all historical training samples. The effectiveness of the proposed method is verified by a real hydraulic system and the Tennessee-Eastman benchmark process.

📄 PDF Abstract BibTeX arXiv:2403.13845

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeFault DiagnosisIncremental Learning

Similar Papers 제목 키워드 기반

TMS: Trajectory-Mixed Supervision for Reward-Free, On-Policy SFT

2026-02-03 · Rana Muhammad Shahroz Khan, Zijie Liu, Zhen Tan, Charles Fleming 외 arxiv

Reinforcement Learning (RL) and Supervised Fine-Tuning (SFT) are the two dominant paradigms for enhancing Large Language Model (LLM) performance on downstream tasks. While RL generally preserves broader model capabilitie…

Reinforcement Learning

Rehearsal-Free Domain Continual Face Anti-Spoofing: Generalize More and Forget Less

2023-03-16 · ICCV 2023 1 · Rizhao Cai, Yawen Cui, Zhi Li, Zitong Yu 외

Face Anti-Spoofing (FAS) is recently studied under the continual learning setting, where the FAS models are expected to evolve after encountering the data from new domains. However, existing methods need extra replay buf…

Continual LearningDomain GeneralizationFace Anti-Spoofing

DEMix Layers: Disentangling Domains for Modular Language Modeling

2021-10-16 · ACL ARR October 2021 10 · Anonymous

We introduce a new domain expert mixture (DEMix) layer that enables conditioning a language model (LM) on the domain of the input text. A DEMix layer is a collection of expert feedforward networks, each specialized to a…

Language ModelingLanguage Modelling

Mapping Post-Training Forgetting in Language Models at Scale

2025-10-20 · Jackson Harmon, Andreas Hochlehnert, Matthias Bethge, Ameya Prabhu arxiv

Scaled post-training now drives many of the largest capability gains in language models (LMs), yet its effect on pretrained knowledge remains poorly understood. Not all forgetting is equal: Forgetting one fact (e.g., a U…

Continual Pretraining

Exploring Pretraining via Active Forgetting for Improving Cross Lingual Transfer for Decoder Language Models

2024-10-21 · Divyanshu Aggarwal, Ashutosh Sathe, Sunayana Sitaram

Large Language Models (LLMs) demonstrate exceptional capabilities in a multitude of NLP tasks. However, the efficacy of such models to languages other than English is often limited. Prior works have shown that encoder-on…

Cross-Lingual TransferDecoder