Dynamic Adaptive Threshold based Learning for Noisy Annotations Robust Facial Expression Recognition
The real-world facial expression recognition (FER) datasets suffer from noisy annotations due to crowd-sourcing, ambiguity in expressions, the subjectivity of annotators and inter-class similarity. However, the recent deep networks have strong capacity to memorize the noisy annotations leading to corrupted feature embedding and poor generalization. To handle noisy annotations, we propose a dynamic FER learning framework (DNFER) in which clean samples are selected based on dynamic class specific threshold during training. Specifically, DNFER is based on supervised training using selected clean samples and unsupervised consistent training using all the samples. During training, the mean posterior class probabilities of each mini-batch is used as dynamic class-specific threshold to select the clean samples for supervised training. This threshold is independent of noise rate and does not need any clean data unlike other methods. In addition, to learn from all samples, the posterior distributions between weakly-augmented image and strongly-augmented image are aligned using an unsupervised consistency loss. We demonstrate the robustness of DNFER on both synthetic as well as on real noisy annotated FER datasets like RAFDB, FERPlus, SFEW and AffectNet.
Code (1)
Tasks
Facial Expression RecognitionFacial Expression Recognition (FER)Similar Papers 제목 키워드 기반
Class adaptive threshold and negative class guided noisy annotation robust Facial Expression Recognition
The hindering problem in facial expression recognition (FER) is the presence of inaccurate annotations referred to as noisy annotations in the datasets. These noisy annotations are present in the datasets inherently beca…
Facial Expression RecognitionFacial Expression Recognition (FER)ASM: Adaptive Sample Mining for In-The-Wild Facial Expression Recognition
Given the similarity between facial expression categories, the presence of compound facial expressions, and the subjectivity of annotators, facial expression recognition (FER) datasets often suffer from ambiguity and noi…
Facial Expression RecognitionFacial Expression Recognition (FER)Beard Segmentation and Recognition Bias
A person's facial hairstyle, such as presence and size of beard, can significantly impact face recognition accuracy. There are publicly-available deep networks that achieve reasonable accuracy at binary attribute classif…
AttributeFace RecognitionSegmentationFacial Emotion Recognition with Noisy Multi-task Annotations
Human emotions can be inferred from facial expressions. However, the annotations of facial expressions are often highly noisy in common emotion coding models, including categorical and dimensional ones. To reduce human l…
Emotion RecognitionFacial Emotion RecognitionDAC: 2D-3D Retrieval with Noisy Labels via Divide-and-Conquer Alignment and Correction
With the recent burst of 2D and 3D data, cross-modal retrieval has attracted increasing attention recently. However, manual labeling by non-experts will inevitably introduce corrupted annotations given ambiguous 2D/3D co…
cross-modal alignmentCross-Modal RetrievalRetrieval