Consensual Collaborative Training And Knowledge Distillation Based Facial Expression Recognition Under Noisy Annotations
Presence of noise in the labels of large scale facial expression datasets has been a key challenge towards Facial Expression Recognition (FER) in the wild. During early learning stage, deep networks fit on clean data. Then, eventually, they start overfitting on noisy labels due to their memorization ability, which limits FER performance. This work proposes an effective training strategy in the presence of noisy labels, called as Consensual Collaborative Training (CCT) framework. CCT co-trains three networks jointly using a convex combination of supervision loss and consistency loss, without making any assumption about the noise distribution. A dynamic transition mechanism is used to move from supervision loss in early learning to consistency loss for consensus of predictions among networks in the later stage. Inference is done using a single network based on a simple knowledge distillation scheme. Effectiveness of the proposed framework is demonstrated on synthetic as well as real noisy FER datasets. In addition, a large test subset of around 5K images is annotated from the FEC dataset using crowd wisdom of 16 different annotators and reliable labels are inferred. CCT is also validated on it. State-of-the-art performance is reported on the benchmark FER datasets RAFDB (90.84%) FERPlus (89.99%) and AffectNet (66%). Our codes are available at https://github.com/1980x/CCT.
Code (3)
Tasks
Facial Expression RecognitionFacial Expression Recognition (FER)Knowledge DistillationMemorizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Compressing Facial Makeup Transfer Networks by Collaborative Distillation and Kernel Decomposition
Although the facial makeup transfer network has achieved high-quality performance in generating perceptually pleasing makeup images, its capability is still restricted by the massive computation and storage of the networ…
DecoderFacial Makeup TransferFederated Learning via Input-Output Collaborative Distillation
Federated learning (FL) is a machine learning paradigm in which distributed local nodes collaboratively train a central model without sharing individually held private data. Existing FL methods either iteratively share l…
Federated Learningimage-classificationImage ClassificationAffect Expression Behaviour Analysis in the Wild using Consensual Collaborative Training
Facial expression recognition (FER) in the wild is crucial for building reliable human-computer interactive systems. However, annotations of large scale datasets in FER has been a key challenge as these datasets suffer f…
Facial Expression RecognitionFacial Expression Recognition (FER)MemorizationA Consensual Collaborative Learning Method for Remote Sensing Image Classification Under Noisy Multi-Labels
Collecting a large number of reliable training images annotated by multiple land-cover class labels in the framework of multi-label classification is time-consuming and costly in remote sensing (RS). To address this prob…
image-classificationImage ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+2Heterogeneous-Branch Collaborative Learning for Dialogue Generation
With the development of deep learning, advanced dialogue generation methods usually require a greater amount of computational resources. One promising approach to obtaining a high-performance and lightweight model is kno…
AttributeDialogue GenerationKnowledge Distillation