paper-with-me

홈 › Papers

Unsupervised Unlearning of Concept Drift with Autoencoders

2022-11-23 · André Artelt, Kleanthis Malialis, Christos Panayiotou, Marios Polycarpou, Barbara Hammer

Concept drift refers to a change in the data distribution affecting the data stream of future samples. Consequently, learning models operating on the data stream might become obsolete, and need costly and difficult adjustments such as retraining or adaptation. Existing methods usually implement a local concept drift adaptation scheme, where either incremental learning of the models is used, or the models are completely retrained when a drift detection mechanism triggers an alarm. This paper proposes an alternative approach in which an unsupervised and model-agnostic concept drift adaptation method at the global level is introduced, based on autoencoders. Specifically, the proposed method aims to ``unlearn'' the concept drift without having to retrain or adapt any of the learning models operating on the data. An extensive experimental evaluation is conducted in two application domains. We consider a realistic water distribution network with more than 30 models in-place, from which we create 200 simulated data sets / scenarios. We further consider an image-related task to demonstrate the effectiveness of our method.

📄 PDF Abstract BibTeX arXiv:2211.12989

Code (1)

hammerlabml/unsupervisedunlearningconceptdriftautoencoders 공식 구현 jax

Tasks

Drift DetectionIncremental Learning

Similar Papers 제목 키워드 기반

SAeUron: Interpretable Concept Unlearning in Diffusion Models with Sparse Autoencoders

2025-01-29 · Bartosz Cywiński, Kamil Deja

Diffusion models, while powerful, can inadvertently generate harmful or undesirable content, raising significant ethical and safety concerns. Recent machine unlearning approaches offer potential solutions but often lack …

Adversarial AttackDenoisingfeature selectionMachine Unlearning

SAUCE: Selective Concept Unlearning in Vision-Language Models with Sparse Autoencoders

2025-03-16 · Qing Li, Jiahui Geng, Derui Zhu, Fengyu Cai 외

Unlearning methods for vision-language models (VLMs) have primarily adapted techniques from large language models (LLMs), relying on weight updates that demand extensive annotated forget sets. Moreover, these methods per…

Open World Autoencoding Drift Detection with Novel Class Recognition in Tabular Non-stationary Data Streams

2026-05-28 · Joanna Komorniczak arxiv

Data stream processing has become a landmark in modern machine learning applications, with concept drifts and novel class appearances posing the primary challenges faced by sophisticated recognition methods. This work pr…

Density Estimation

A Unifying Framework for Unsupervised Concept Extraction

2026-04-27 · Chandler Squires, Pradeep Ravikumar arxiv

Techniques for concept extraction, such as sparse autoencoders and transcoders, aim to extract high-level symbolic concepts from low-level nonsymbolic representations. When these extracted concepts are used for downstrea…

Continual Unlearning for Text-to-Image Diffusion Models: A Regularization Perspective

2025-11-11 · Justin Lee, Zheda Mai, Jinsu Yoo, Chongyu Fan 외 arxiv

Machine unlearning--the ability to remove designated concepts from a pre-trained model--has advanced rapidly, particularly for text-to-image diffusion models. However, existing methods typically assume that unlearning re…

Text-to-Image Generation