paper-with-me

홈 › Papers

Improving Fairness and Mitigating MADness in Generative Models

2024-05-22 · Paul Mayer, Lorenzo Luzi, Ali Siahkoohi, Don H. Johnson, Richard G. Baraniuk

Generative models unfairly penalize data belonging to minority classes, suffer from model autophagy disorder (MADness), and learn biased estimates of the underlying distribution parameters. Our theoretical and empirical results show that training generative models with intentionally designed hypernetworks leads to models that 1) are more fair when generating datapoints belonging to minority classes 2) are more stable in a self-consumed (i.e., MAD) setting, and 3) learn parameters that are less statistically biased. To further mitigate unfairness, MADness, and bias, we introduce a regularization term that penalizes discrepancies between a generative model's estimated weights when trained on real data versus its own synthetic data. To facilitate training existing deep generative models within our framework, we offer a scalable implementation of hypernetworks that automatically generates a hypernetwork architecture for any given generative model.

📄 PDF Abstract BibTeX arXiv:2405.13977

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness

Methods 이 논문이 사용한 방법론

HyperNetwork A HyperNetwork is a network that generates weights for a main network. The behavior of the main network is the same with any usual neural network: it learns to map some raw…

Similar Papers 제목 키워드 기반

March Madness Tournament Predictions Model: A Mathematical Modeling Approach

2025-03-17 · Christian McIver, Karla Avalos, Nikhil Nayak

This paper proposes a model to predict the outcome of the March Madness tournament based on historical NCAA basketball data since 2013. The framework of this project is a simplification of the FiveThrityEight NCAA March …

Self-Improving Diffusion Models with Synthetic Data

2024-08-29 · Sina AlEMohammad, Ahmed Imtiaz Humayun, Shruti Agarwal, John Collomosse 외

The artificial intelligence (AI) world is running out of real data for training increasingly large generative models, resulting in accelerating pressure to train on synthetic data. Unfortunately, training new generative …

FairnessImage Generation

Paranoid Transformer: Reading Narrative of Madness as Computational Approach to Creativity

2020-07-13 · Yana Agafonova, Alexey Tikhonov, Ivan P. Yamshchikov

This papers revisits the receptive theory in context of computational creativity. It presents a case study of a Paranoid Transformer - a fully autonomous text generation engine with raw output that could be read as the n…

Text Generation

Reasoning Towards Fairness: Mitigating Bias in Language Models through Reasoning-Guided Fine-Tuning

2025-04-08 · Sanchit Kabra, Akshita Jha, Chandan K. Reddy

Recent advances in large-scale generative language models have shown that reasoning capabilities can significantly improve model performance across a variety of tasks. However, the impact of reasoning on a model's abilit…

Fairness

Mitigating Unfairness via Evolutionary Multi-objective Ensemble Learning

2022-10-30 · Zhang Qingquan, Liu Jialin, Zhang Zeqi, Wen Junyi 외

In the literature of mitigating unfairness in machine learning, many fairness measures are designed to evaluate predictions of learning models and also utilised to guide the training of fair models. It has been theoretic…

Ensemble LearningFairness