Attention Based Fully Convolutional Network for Speech Emotion Recognition
Speech emotion recognition is a challenging task for three main reasons: 1) human emotion is abstract, which means it is hard to distinguish; 2) in general, human emotion can only be detected in some specific moments during a long utterance; 3) speech data with emotional labeling is usually limited. In this paper, we present a novel attention based fully convolutional network for speech emotion recognition. We employ fully convolutional network as it is able to handle variable-length speech, free of the demand of segmentation to keep critical information not lost. The proposed attention mechanism can make our model be aware of which time-frequency region of speech spectrogram is more emotion-relevant. Considering limited data, the transfer learning is also adapted to improve the accuracy. Especially, it's interesting to observe obvious improvement obtained with natural scene image based pre-trained model. Validated on the publicly available IEMOCAP corpus, the proposed model outperformed the state-of-the-art methods with a weighted accuracy of 70.4% and an unweighted accuracy of 63.9% respectively.
Code (1)
Tasks
Emotion RecognitionSpeech Emotion RecognitionTransfer LearningSimilar Papers 제목 키워드 기반
Convolutional Attention Networks for Multimodal Emotion Recognition from Speech and Text Data
Emotion recognition has become a popular topic of interest, especially in the field of human computer interaction. Previous works involve unimodal analysis of emotion, while recent efforts focus on multi-modal emotion re…
Emotion RecognitionMultimodal Emotion RecognitionEfficient Arabic emotion recognition using deep neural networks
Emotion recognition from speech signal based on deep learning is an active research area. Convolutional neural networks (CNNs) may be the dominant method in this area. In this paper, we implement two neural architectures…
Emotion RecognitionSpeech Emotion RecognitionLight-SERNet: A lightweight fully convolutional neural network for speech emotion recognition
Detecting emotions directly from a speech signal plays an important role in effective human-computer interactions. Existing speech emotion recognition models require massive computational and storage resources, making th…
Emotion RecognitionSpeech Emotion RecognitionSpeech Emotion Recognition Via CNN-Transformer and Multidimensional Attention Mechanism
Speech Emotion Recognition (SER) is crucial in human-machine interactions. Mainstream approaches utilize Convolutional Neural Networks or Recurrent Neural Networks to learn local energy feature representations of speech …
Emotion RecognitionSpeech Emotion RecognitionMulti-Scale Temporal Transformer For Speech Emotion Recognition
Speech emotion recognition plays a crucial role in human-machine interaction systems. Recently various optimized Transformers have been successfully applied to speech emotion recognition. However, the existing Transforme…
Emotion RecognitionSpeech Emotion Recognition