paper-with-me

홈 › Papers

EmotionNet Nano: An Efficient Deep Convolutional Neural Network Design for Real-time Facial Expression Recognition

2020-06-29 · James Ren Hou Lee, Linda Wang, Alexander Wong

While recent advances in deep learning have led to significant improvements in facial expression classification (FEC), a major challenge that remains a bottleneck for the widespread deployment of such systems is their high architectural and computational complexities. This is especially challenging given the operational requirements of various FEC applications, such as safety, marketing, learning, and assistive living, where real-time requirements on low-cost embedded devices is desired. Motivated by this need for a compact, low latency, yet accurate system capable of performing FEC in real-time on low-cost embedded devices, this study proposes EmotionNet Nano, an efficient deep convolutional neural network created through a human-machine collaborative design strategy, where human experience is combined with machine meticulousness and speed in order to craft a deep neural network design catered towards real-time embedded usage. Two different variants of EmotionNet Nano are presented, each with a different trade-off between architectural and computational complexity and accuracy. Experimental results using the CK+ facial expression benchmark dataset demonstrate that the proposed EmotionNet Nano networks demonstrated accuracies comparable to state-of-the-art in FEC networks, while requiring significantly fewer parameters (e.g., 23$\times$ fewer at a higher accuracy). Furthermore, we demonstrate that the proposed EmotionNet Nano networks achieved real-time inference speeds (e.g. $>25$ FPS and $>70$ FPS at 15W and 30W, respectively) and high energy efficiency (e.g. $>1.7$ images/sec/watt at 15W) on an ARM embedded processor, thus further illustrating the efficacy of EmotionNet Nano for deployment on embedded devices.

📄 PDF Abstract BibTeX arXiv:2006.15759

Code (1)

Hamiedamr/EmotionNet-Nano-An-Efficient-Deep-Convolutional-Neural-Network-Design-for-Real-time-Facial-Expressi

Tasks

Facial Expression RecognitionFacial Expression Recognition (FER)Marketing

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

HetEmotionNet: Two-Stream Heterogeneous Graph Recurrent Neural Network for Multi-modal Emotion Recognition

2021-08-07 · Ziyu Jia, Youfang Lin, Jing Wang, Zhiyang Feng 외

The research on human emotion under multimedia stimulation based on physiological signals is an emerging field, and important progress has been achieved for emotion recognition based on multi-modal signals. However, it i…

Emotion Recognition

CIT-EmotionNet: CNN Interactive Transformer Network for EEG Emotion Recognition

2023-05-07 · Wei Lu, Hua Ma, Tien-Ping Tan

Emotion recognition using Electroencephalogram (EEG) signals has emerged as a significant research challenge in affective computing and intelligent interaction. However, effectively combining global and local features of…

EEGEEG Emotion RecognitionElectroencephalogram (EEG)Emotion Recognition

ECG-EmotionNet: Nested Mixture of Expert (NMoE) Adaptation of ECG-Foundation Model for Driver Emotion Recognition

2025-03-03 · Nastaran Mansourian, Arash Mohammadi, M. Omair Ahmad, M. N. S. Swamy

Driver emotion recognition plays a crucial role in driver monitoring systems, enhancing human-autonomy interactions and the trustworthiness of Autonomous Driving (AD). Various physiological and behavioural modalities hav…

Autonomous DrivingComputational EfficiencyEmotion RecognitionMixture-of-Experts

Edu-EmotionNet: Cross-Modality Attention Alignment with Temporal Feedback Loops

2025-10-09 · S M Rafiuddin arxiv

Understanding learner emotions in online education is critical for improving engagement and personalized instruction. While prior work in emotion recognition has explored multimodal fusion and temporal modeling, existing…

Emotion Recognition

Designing nanophotonic structures using conditional-deep convolutional generative adversarial networks

2019-03-20 · Sunae So, Junsuk Rho

Data-driven design approaches based on deep-learning have been introduced in nanophotonics to reduce time-consuming iterative simulations which have been a major challenge. Here, we report the first use of conditional de…

Form