paper-with-me

홈 › Papers

Fair Feature Distillation for Visual Recognition

2021-05-27 · CVPR 2021 1 · Sangwon Jung, DongGyu Lee, TaeEon Park, Taesup Moon

Fairness is becoming an increasingly crucial issue for computer vision, especially in the human-related decision systems. However, achieving algorithmic fairness, which makes a model produce indiscriminative outcomes against protected groups, is still an unresolved problem. In this paper, we devise a systematic approach which reduces algorithmic biases via feature distillation for visual recognition tasks, dubbed as MMD-based Fair Distillation (MFD). While the distillation technique has been widely used in general to improve the prediction accuracy, to the best of our knowledge, there has been no explicit work that also tries to improve fairness via distillation. Furthermore, We give a theoretical justification of our MFD on the effect of knowledge distillation and fairness. Throughout the extensive experiments, we show our MFD significantly mitigates the bias against specific minorities without any loss of the accuracy on both synthetic and real-world face datasets.

📄 PDF Abstract BibTeX arXiv:2106.04411

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessKnowledge Distillation

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Toward Fair Graph Neural Networks Via Dual-Teacher Knowledge Distillation

2024-11-30 · Chengyu Li, Debo Cheng, Guixian Zhang, Yi Li 외

Graph Neural Networks (GNNs) have demonstrated strong performance in graph representation learning across various real-world applications. However, they often produce biased predictions caused by sensitive attributes, su…

FairnessGraph Representation LearningKnowledge DistillationRepresentation Learning

How Knowledge Distillation Mitigates the Synthetic Gap in Fair Face Recognition

2024-08-30 · Pedro C. Neto, Ivona Colakovic, Sašo Karakatič, Ana F. Sequeira

Leveraging the capabilities of Knowledge Distillation (KD) strategies, we devise a strategy to fight the recent retraction of face recognition datasets. Given a pretrained Teacher model trained on a real dataset, we show…

Face RecognitionFairnessKnowledge Distillation

Class-Balanced Distillation for Long-Tailed Visual Recognition

2021-04-12 · Ahmet Iscen, André Araujo, Boqing Gong, Cordelia Schmid

Real-world imagery is often characterized by a significant imbalance of the number of images per class, leading to long-tailed distributions. An effective and simple approach to long-tailed visual recognition is to learn…

Image ClassificationKnowledge DistillationLong-tail Learning

Symmetrical Linguistic Feature Distillation with CLIP for Scene Text Recognition

2023-10-08 · Zixiao Wang, Hongtao Xie, Yuxin Wang, Jianjun Xu 외

In this paper, we explore the potential of the Contrastive Language-Image Pretraining (CLIP) model in scene text recognition (STR), and establish a novel Symmetrical Linguistic Feature Distillation framework (named CLIP-…

Image to textOptical Character Recognition (OCR)Scene Text Recognition

Whose Emotion Matters? Speaking Activity Localisation without Prior Knowledge

2022-11-23 · Hugo Carneiro, Cornelius Weber, Stefan Wermter

The task of emotion recognition in conversations (ERC) benefits from the availability of multiple modalities, as provided, for example, in the video-based Multimodal EmotionLines Dataset (MELD). However, only a few resea…

Active Speaker DetectionAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)Emotion Recognition+2