Multi-stream Attention-based BLSTM with Feature Segmentation for Speech Emotion Recognition
This paper proposes a speech emotion recognition technique that considers the suprasegmental characteristics and temporal change of individual speech parameters. In recent years, speech emotion recognition using Bidirectional LSTM (BLSTM) has been studied actively because the model can focus on a particular temporal region that contains strong emotional characteristics. One of the model’s weaknesses is that it cannot consider the statistics of speech features, which are known to be effective for speech emotion recognition. Besides, this method cannot train individual attention parameters for different descriptors because it handles the input sequence by a single BLSTM. In this paper, we introduce feature segmentation and multi-stream processing into attention-based BLSTM to solve these problems. In addition, we employed data augmentation based on emotional speech synthesis in a training step. The classification experiments between four emotions (i.e., anger, joy, neutral, and sadness) using the Japanese Twitter-based Emotional Speech corpus (JTES) showed that the proposed method obtained a recognition accuracy of 73.4%, which is comparable to human evaluation (75.5%).
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationEmotional Speech SynthesisEmotion RecognitionSpeech Emotion RecognitionSpeech SynthesisSimilar Papers 제목 키워드 기반
High Performance Sequence-to-Sequence Model for Streaming Speech Recognition
Recently sequence-to-sequence models have started to achieve state-of-the-art performance on standard speech recognition tasks when processing audio data in batch mode, i.e., the complete audio data is available when sta…
speech-recognitionSpeech RecognitionVocal Bursts Intensity PredictionEnd-to-End Multi-View Lipreading
Non-frontal lip views contain useful information which can be used to enhance the performance of frontal view lipreading. However, the vast majority of recent lipreading works, including the deep learning approaches whic…
General ClassificationLipreadingEnd-to-End Audiovisual Fusion with LSTMs
Several end-to-end deep learning approaches have been recently presented which simultaneously extract visual features from the input images and perform visual speech classification. However, research on jointly extractin…
ClassificationGeneral Classificationspeech-recognitionSpeech RecognitionPre-trained Deep Convolution Neural Network Model With Attention for Speech Emotion Recognition
Speech emotion recognition (SER) is a difficult and challenging task because of the affective variances between different speakers. The performances of SER are extremely reliant on the extracted features from speech sign…
Emotion RecognitionSentenceSpeech Emotion RecognitionUtterance-level end-to-end language identification using attention-based CNN-BLSTM
In this paper, we present an end-to-end language identification framework, the attention-based Convolutional Neural Network-Bidirectional Long-short Term Memory (CNN-BLSTM). The model is performed on the utterance level,…
Language Identification