paper-with-me

Papers

AutoDebias: Automated Framework for Debiasing Text-to-Image Models

2025-08-01 · Hongyi Cai, Mohammad Mahdinur Rahman, Mingkang Dong, Muxin Pu, Moqyad Alqaily, Jie Li, Xinfeng Li, Jialie Shen, Meikang Qiu, Qingsong Wen arxiv

Text-to-Image (T2I) models generate high-quality images but are vulnerable to malicious backdoor attacks that inject harmful biases (e.g., trigger-activated gender or racial stereotypes). Existing debiasing methods, often designed for natural statistical biases, struggle with these deliberately and subtly injected attacks. We propose AutoDebias, a framework that automatically identifies and mitigates these malicious biases in T2I models without prior knowledge of the specific attack types. Specifically, AutoDebias leverages vision-language models to detect trigger-activated visual patterns and constructs neutralization guides by generating counter-prompts. These guides drive a CLIP-guided training process that breaks the harmful associations while preserving the original model's image quality and diversity. Unlike methods designed for natural bias, AutoDebias effectively addresses subtle, injected stereotypes and multiple interacting attacks. We evaluate the framework on a new benchmark covering 17 distinct backdoor scenarios, including challenging cases where multiple backdoors co-exist. AutoDebias detects malicious patterns with 91.6% accuracy and reduces the backdoor success rate from 90% to negligible levels, while preserving the visual fidelity of the original model.

📄 PDF Abstract BibTeX arXiv:2508.00445

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

AutoDebias: Learning to Debias for Recommendation

2021-05-10 · Jiawei Chen, Hande Dong, Yang Qiu, Xiangnan He 외

Recommender systems rely on user behavior data like ratings and clicks to build personalization model. However, the collected data is observational rather than experimental, causing various biases in the data which signi…

ImputationMeta-LearningRecommendation Systems

Skin Deep Unlearning: Artefact and Instrument Debiasing in the Context of Melanoma Classification

2021-09-20 · Peter J. Bevan, Amir Atapour-Abarghouei

Convolutional Neural Networks have demonstrated dermatologist-level performance in the classification of melanoma from skin lesion images, but prediction irregularities due to biases seen within the training data are an …

Skin Cancer Classification

FairImagen: Post-Processing for Bias Mitigation in Text-to-Image Models

2025-10-24 · Zihao Fu, Ryan Brown, Shun Shao, Kai Rawal 외 arxiv

Text-to-image diffusion models, such as Stable Diffusion, have demonstrated remarkable capabilities in generating high-quality and diverse images from natural language prompts. However, recent studies reveal that these m…

Text-to-Image Generation

Target-oriented Multimodal Sentiment Classification with Counterfactual-enhanced Debiasing

2025-09-11 · Zhiyue Liu, Fanrong Ma, Xin Ling arxiv

Target-oriented multimodal sentiment classification seeks to predict sentiment polarity for specific targets from image-text pairs. While existing works achieve competitive performance, they often over-rely on textual co…

Contrastive LearningData Augmentation

Challenges in Automated Debiasing for Toxic Language Detection

2021-01-29 · EACL 2021 2 · Xuhui Zhou, Maarten Sap, Swabha Swayamdipta, Noah A. Smith 외

Biased associations have been a challenge in the development of classifiers for detecting toxic language, hindering both fairness and accuracy. As potential solutions, we investigate recently introduced debiasing methods…

Fairnesstext-classificationText Classification