paper-with-me

홈 › Papers

GENIU: A Restricted Data Access Unlearning for Imbalanced Data

2024-06-12 · Chenhao Zhang, Shaofei Shen, Yawen Zhao, Weitong Tony Chen, Miao Xu

With the increasing emphasis on data privacy, the significance of machine unlearning has grown substantially. Class unlearning, which involves enabling a trained model to forget data belonging to a specific class learned before, is important as classification tasks account for the majority of today's machine learning as a service (MLaaS). Retraining the model on the original data, excluding the data to be forgotten (a.k.a forgetting data), is a common approach to class unlearning. However, the availability of original data during the unlearning phase is not always guaranteed, leading to the exploration of class unlearning with restricted data access. While current unlearning methods with restricted data access usually generate proxy sample via the trained neural network classifier, they typically focus on training and forgetting balanced data. However, the imbalanced original data can cause trouble for these proxies and unlearning, particularly when the forgetting data consists predominantly of the majority class. To address this issue, we propose the GENerative Imbalanced Unlearning (GENIU) framework. GENIU utilizes a Variational Autoencoder (VAE) to concurrently train a proxy generator alongside the original model. These generated proxies accurately represent each class and are leveraged in the unlearning phase, eliminating the reliance on the original training data. To further mitigate the performance degradation resulting from forgetting the majority class, we introduce an in-batch tuning strategy that works with the generated proxies. GENIU is the first practical framework for class unlearning in imbalanced data settings and restricted data access, ensuring the preservation of essential information for future unlearning. Experimental results confirm the superiority of GENIU over existing methods, establishing its effectiveness in empirical scenarios.

📄 PDF Abstract BibTeX arXiv:2406.07885

Code (0)

등록된 구현이 없습니다.

Tasks

Machine Unlearning

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generation

2025-06-03 · Siqi Chen, Xinyu Dong, Haolei Xu, Xingyu Wu 외

Large Language Models (LLMs) and Multimodal LLMs have shown promising capabilities for SVG processing, yet existing benchmarks suffer from limited real-world coverage, lack of complexity stratification, and fragmented ev…

BenchmarkingStyle TransferVector Graphics

GENIUS: Sketch-based Language Model Pre-training via Extreme and Selective Masking for Text Generation and Augmentation

2022-11-18 · Biyang Guo, Yeyun Gong, Yelong Shen, Songqiao Han 외

We introduce GENIUS: a conditional text generation model using sketches as input, which can fill in the missing contexts for a given sketch (key information consisting of textual spans, phrases, or words, concatenated by…

Conditional Text GenerationData AugmentationLanguage ModelingLanguage Modelling+10

ST$^2$U: Stateful Test-Time Unlearning via Restricted Knowledge Boundary Control

2026-08-24 · Xunlei Chen, Qinghui Gong, Ruini Xue, Yaodong Hu 외 arxiv

Controlling restricted knowledge in large language models is essential for model alignment and safe deployment. Test-time unlearning avoids costly retraining and parameter updates by intervening only during inference. Ho…

GENIUS: A Generative Framework for Universal Multimodal Search

2025-03-25 · CVPR 2025 1 · Sungyeon Kim, Xinliang Zhu, Xiaofan Lin, Muhammet Bastan 외

Generative retrieval is an emerging approach in information retrieval that generates identifiers (IDs) of target data based on a query, providing an efficient alternative to traditional embedding-based retrieval methods.…

Information RetrievalQuantizationRe-RankingRetrieval

FactGenius: Combining Zero-Shot Prompting and Fuzzy Relation Mining to Improve Fact Verification with Knowledge Graphs

2024-06-03 · Sushant Gautam

Fact-checking is a crucial natural language processing (NLP) task that verifies the truthfulness of claims by considering reliable evidence. Traditional methods are often limited by labour-intensive data curation and rul…

Fact CheckingFact VerificationKnowledge GraphsText Matching