Face4FairShifts: A Large Image Benchmark for Fairness and Robust Learning across Visual Domains

2025-08-31 · Yumeng Lin, Dong Li, Xintao Wu, Minglai Shao, Xujiang Zhao, Zhong Chen, Chen Zhao arxiv

Ensuring fairness and robustness in machine learning models remains a challenge, particularly under domain shifts. We present Face4FairShifts, a large-scale facial image benchmark designed to systematically evaluate fairness-aware learning and domain generalization. The dataset includes 100,000 images across four visually distinct domains with 39 annotations within 14 attributes covering demographic and facial features. Through extensive experiments, we analyze model performance under distribution shifts and identify significant gaps. Our findings emphasize the limitations of existing related datasets and the need for more effective fairness-aware domain adaptation techniques. Face4FairShifts provides a comprehensive testbed for advancing equitable and reliable AI systems. The dataset is available online at https://meviuslab.github.io/Face4FairShifts/.

📄 PDF Abstract BibTeX arXiv:2509.00658

Code (0)

등록된 구현이 없습니다.

Tasks

Domain Generalization Domain Adaptation

Benchmarking the Fairness of Image Upsampling Methods

2024-01-24 · Mike Laszkiewicz, Imant Daunhawer, Julia E. Vogt, Asja Fischer 외

Recent years have witnessed a rapid development of deep generative models for creating synthetic media, such as images and videos. While the practical applications of these models in everyday tasks are enticing, it is cr…

Benchmarking Diversity Fairness

Demographic Fairness in Multimodal LLMs: A Benchmark of Gender and Ethnicity Bias in Face Verification

2026-03-26 · Ünsal Öztürk, Hatef Otroshi Shahreza, Sébastien Marcel arxiv

Multimodal Large Language Models (MLLMs) have recently been explored as face verification systems that determine whether two face images are of the same person. Unlike dedicated face recognition systems, MLLMs approach t…

Face Verification Face Recognition

AI-Face: A Million-Scale Demographically Annotated AI-Generated Face Dataset and Fairness Benchmark

2024-06-02 · CVPR 2025 1 · Li Lin, Santosh, Xin Wang, Shu Hu

AI-generated faces have enriched human life, such as entertainment, education, and art. However, they also pose misuse risks. Therefore, detecting AI-generated faces becomes crucial, yet current detectors show biased per…

Face Swapping Fairness

Fairness Testing of Deep Image Classification with Adequacy Metrics

2021-11-17 · Peixin Zhang, Jingyi Wang, Jun Sun, Xinyu Wang

As deep image classification applications, e.g., face recognition, become increasingly prevalent in our daily lives, their fairness issues raise more and more concern. It is thus crucial to comprehensively test the fairn…

Classification Face Recognition Fairness image-classification+1

FairFaceGAN: Fairness-aware Facial Image-to-Image Translation

2020-12-01 · Sunhee Hwang, Sungho Park, Dohyung Kim, Mirae Do 외

In this paper, we introduce FairFaceGAN, a fairness-aware facial Image-to-Image translation model, mitigating the problem of unwanted translation in protected attributes (e.g., gender, age, race) during facial attributes…

Attribute Fairness Image-to-Image Translation Translation