Which CNNs and Training Settings to Choose for Action Unit Detection? A Study Based on a Large-Scale Dataset
In this paper we explore the influence of some frequently used Convolutional Neural Networks (CNNs), training settings, and training set structures, on Action Unit (AU) detection. Specifically, we first compare 10 different shallow and deep CNNs in AU detection. Second, we investigate how the different training settings (i.e. centering/normalizing the inputs, using different augmentation severities, and balancing the data) impact the performance in AU detection. Third, we explore the effect of increasing the number of labelled subjects and frames in the training set on the AU detection performance. These comparisons provide the research community with useful tips about the choice of different CNNs and training settings in AU detection. In our analysis, we use a large-scale naturalistic dataset, consisting of ~55K videos captured in the wild. To the best of our knowledge, there is no work that had investigated the impact of such settings on a large-scale AU dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Action Unit DetectionSimilar Papers 제목 키워드 기반
Choose Settings Carefully: Comparing Action Unit detection at Different Settings Using a Large-Scale Dataset
In this paper, we investigate the impact of some of the commonly used settings for (a) preprocessing face images, and (b) classification and training, on Action Unit (AU) detection performance and complexity. We use in o…
Action Unit DetectionClassificationVisual Diagnostics for Deep Reinforcement Learning Policy Development
Modern vision-based reinforcement learning techniques often use convolutional neural networks (CNN) as universal function approximators to choose which action to take for a given visual input. Until recently, CNNs have b…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Selective Volume Mixup for Video Action Recognition
The recent advances in Convolutional Neural Networks (CNNs) and Vision Transformers have convincingly demonstrated high learning capability for video action recognition on large datasets. Nevertheless, deep models often …
Action RecognitionImage AugmentationTemporal Action LocalizationConvolutional Neural Networks Can (Meta-)Learn the Same-Different Relation
While convolutional neural networks (CNNs) have come to match and exceed human performance in many settings, the tasks these models optimize for are largely constrained to the level of individual objects, such as classif…
Meta-LearningRelationLearning Discriminative Features Via Weights-biased Softmax Loss
Loss functions play a key role in training superior deep neural networks. In convolutional neural networks (CNNs), the popular cross entropy loss together with softmax does not explicitly guarantee minimization of intra-…
image-classificationImage Classification