Vision Transformer for Action Units Detection
Facial Action Units detection (FAUs) represents a fine-grained classification problem that involves identifying different units on the human face, as defined by the Facial Action Coding System. In this paper, we present a simple yet efficient Vision Transformer-based approach for addressing the task of Action Units (AU) detection in the context of Affective Behavior Analysis in-the-wild (ABAW) competition. We employ the Video Vision Transformer(ViViT) Network to capture the temporal facial change in the video. Besides, to reduce massive size of the Vision Transformers model, we replace the ViViT feature extraction layers with the CNN backbone (Regnet). Our model outperform the baseline model of ABAW 2023 challenge, with a notable 14% difference in result. Furthermore, the achieved results are comparable to those of the top three teams in the previous ABAW 2022 challenge.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
AUNet: Learning Relations Between Action Units for Face Forgery Detection
Face forgery detection becomes increasingly crucial due to the serious security issues caused by face manipulation techniques. Recent studies in deepfake detection have yielded promising results when the training and…
DeepFake DetectionFace SwappingRelationEnd-to-End Machine Learning Framework for Facial AU Detection in Intensive Care Units
Pain is a common occurrence among patients admitted to Intensive Care Units. Pain assessment in ICU patients still remains a challenge for clinicians and ICU staff, specifically in cases of non-verbal sedated, mechanical…
Dynamic Relation Transformer for Contextual Text Block Detection
Contextual Text Block Detection (CTBD) is the task of identifying coherent text blocks within the complexity of natural scenes. Previous methodologies have treated CTBD as either a visual relation extraction challenge wi…
DecoderGraph GenerationRelationRelation ExtractionFacial Action Unit Detection With Transformers
The Facial Action Coding System is a taxonomy for fine-grained facial expression analysis. This paper proposes a method for detecting Facial Action Units (FAU), which define particular face muscle activity, from an i…
Action Unit DetectionFacial Action Unit DetectionMulti-Task LearningFlat Multi-modal Interaction Transformer for Named Entity Recognition
Multi-modal named entity recognition (MNER) aims at identifying entity spans and recognizing their categories in social media posts with the aid of images. However, in dominant MNER approaches, the interaction of differe…
Boundary DetectionMulti-modal Named Entity Recognitionnamed-entity-recognitionNamed Entity Recognition+1