paper-with-me

홈 › Papers

On the Robustness of Speech Emotion Recognition for Human-Robot Interaction with Deep Neural Networks

2018-04-06 · Egor Lakomkin, Mohammad Ali Zamani, Cornelius Weber, Sven Magg, Stefan Wermter

Speech emotion recognition (SER) is an important aspect of effective human-robot collaboration and received a lot of attention from the research community. For example, many neural network-based architectures were proposed recently and pushed the performance to a new level. However, the applicability of such neural SER models trained only on in-domain data to noisy conditions is currently under-researched. In this work, we evaluate the robustness of state-of-the-art neural acoustic emotion recognition models in human-robot interaction scenarios. We hypothesize that a robot's ego noise, room conditions, and various acoustic events that can occur in a home environment can significantly affect the performance of a model. We conduct several experiments on the iCub robot platform and propose several novel ways to reduce the gap between the model's performance during training and testing in real-world conditions. Furthermore, we observe large improvements in the model performance on the robot and demonstrate the necessity of introducing several data augmentation techniques like overlaying background noise and loudness variations to improve the robustness of the neural approaches.

📄 PDF Abstract BibTeX arXiv:1804.02173

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationEmotion RecognitionSpeech Emotion Recognition

Similar Papers 제목 키워드 기반

Personalized Speech Emotion Recognition in Human-Robot Interaction using Vision Transformers

2024-09-16 · Ruchik Mishra, Andrew Frye, Madan Mohan Rayguru, Dan O. Popa

Emotions are an essential element in verbal communication, so understanding individuals' affect during a human-robot interaction (HRI) becomes imperative. This paper investigates the application of vision transformer mod…

Emotion RecognitionSpeech Emotion Recognition

Hyperparameters optimization for Deep Learning based emotion prediction for Human Robot Interaction

2020-01-12 · Shruti Jaiswal, Gora Chand Nandi

To enable humanoid robots to share our social space we need to develop technology for easy interaction with the robots using multiple modes such as speech, gestures and share our emotions with them. We have targeted this…

Emotion ClassificationEmotion Recognition

Robust Federated Learning Against Adversarial Attacks for Speech Emotion Recognition

2022-03-09 · Yi Chang, Sofiane Laridi, Zhao Ren, Gregory Palmer 외

Due to the development of machine learning and speech processing, speech emotion recognition has been a popular research topic in recent years. However, the speech data cannot be protected when it is uploaded and process…

Emotion RecognitionFederated LearningSpeech Emotion Recognition

Towards Empathetic Human-Robot Interactions

2016-05-13 · Pascale Fung, Dario Bertero, Yan Wan, Anik Dey 외

Since the late 1990s when speech companies began providing their customer-service software in the market, people have gotten used to speaking to machines. As people interact more often with voice and gesture controlled m…

Sentiment Analysis

Best Practices for Noise-Based Augmentation to Improve the Performance of Deployable Speech-Based Emotion Recognition Systems

2021-04-18 · Mimansa Jaiswal, Emily Mower Provost

Speech emotion recognition is an important component of any human centered system. But speech characteristics produced and perceived by a person can be influenced by a multitude of reasons, both desirable such as emotion…

Adversarial AttackAutomatic Speech RecognitionData AugmentationEmotion Recognition+4