paper-with-me

홈 › Papers

Understanding and Mitigating Annotation Bias in Facial Expression Recognition

2021-08-19 · ICCV 2021 10 · Yunliang Chen, Jungseock Joo

The performance of a computer vision model depends on the size and quality of its training data. Recent studies have unveiled previously-unknown composition biases in common image datasets which then lead to skewed model outputs, and have proposed methods to mitigate these biases. However, most existing works assume that human-generated annotations can be considered gold-standard and unbiased. In this paper, we reveal that this assumption can be problematic, and that special care should be taken to prevent models from learning such annotation biases. We focus on facial expression recognition and compare the label biases between lab-controlled and in-the-wild datasets. We demonstrate that many expression datasets contain significant annotation biases between genders, especially when it comes to the happy and angry expressions, and that traditional methods cannot fully mitigate such biases in trained models. To remove expression annotation bias, we propose an AU-Calibrated Facial Expression Recognition (AUC-FER) framework that utilizes facial action units (AUs) and incorporates the triplet loss into the objective function. Experimental results suggest that the proposed method is more effective in removing expression annotation bias than existing techniques.

📄 PDF Abstract BibTeX arXiv:2108.08504

Code (0)

등록된 구현이 없습니다.

Tasks

Facial Expression RecognitionFacial Expression Recognition (FER)Triplet

Methods 이 논문이 사용한 방법론

Triplet Loss The goal of Triplet loss, in the context of Siamese Networks, is to maximize the joint probability among all score-pairs i.e. the product of all probabilities. By using its…

Similar Papers 제목 키워드 기반

Facial Expressions as a Vulnerability in Face Recognition

2020-11-17 · Alejandro Peña, Ignacio Serna, Aythami Morales, Julian Fierrez 외

This work explores facial expression bias as a security vulnerability of face recognition systems. Despite the great performance achieved by state-of-the-art face recognition systems, the algorithms are still sensitive t…

Face Recognition

Mitigating Algorithmic Bias on Facial Expression Recognition

2023-12-23 · Glauco Amigo, Pablo Rivas Perea, Robert J. Marks

Biased datasets are ubiquitous and present a challenge for machine learning. For a number of categories on a dataset that are equally important but some are sparse and others are common, the learning algorithms will favo…

Facial Expression Recognition

Investigating Bias and Fairness in Facial Expression Recognition

2020-07-20 · Tian Xu, Jennifer White, Sinan Kalkan, Hatice Gunes

Recognition of expressions of emotions and affect from facial images is a well-studied research problem in the fields of affective computing and computer vision with a large number of datasets available containing facial…

AttributeData AugmentationFacial Expression RecognitionFacial Expression Recognition (FER)+1

Towards Fair Affective Robotics: Continual Learning for Mitigating Bias in Facial Expression and Action Unit Recognition

2021-03-15 · Ozgur Kara, Nikhil Churamani, Hatice Gunes

As affective robots become integral in human life, these agents must be able to fairly evaluate human affective expressions without discriminating against specific demographic groups. Identifying bias in Machine Learning…

Continual LearningFacial Expression RecognitionFacial Expression Recognition (FER)Fairness

Mitigating Bias in Facial Analysis Systems by Incorporating Label Diversity

2022-04-13 · Camila Kolling, Victor Araujo, Adriano Veloso, Soraia Raupp Musse

Facial analysis models are increasingly applied in real-world applications that have significant impact on peoples' lives. However, as literature has shown, models that automatically classify facial attributes might exhi…

DiversityEnsemble Learning