Adversarial Machine Learning And Speech Emotion Recognition: Utilizing Generative Adversarial Networks For Robustness
Deep learning has undoubtedly offered tremendous improvements in the performance of state-of-the-art speech emotion recognition (SER) systems. However, recent research on adversarial examples poses enormous challenges on the robustness of SER systems by showing the susceptibility of deep neural networks to adversarial examples as they rely only on small and imperceptible perturbations. In this study, we evaluate how adversarial examples can be used to attack SER systems and propose the first black-box adversarial attack on SER systems. We also explore potential defenses including adversarial training and generative adversarial network (GAN) to enhance robustness. Experimental evaluations suggest various interesting aspects of the effective utilization of adversarial examples useful for achieving robustness for SER systems opening up opportunities for researchers to further innovate in this space.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial AttackBIG-bench Machine LearningEmotion RecognitionGenerative Adversarial NetworkSpeech Emotion RecognitionSimilar Papers 제목 키워드 기반
Adversarial Machine Learning And Speech Emotion Recognition: Utilizing Generative Adversarial Networks For Robustness
Although deep learning has enabled unprecedented improvements in the performance of the state-of-the-art speech emotion recognition (SER) systems, recent research on adversarial examples has cast a shadow of doubt on th…
Adversarial AttackBIG-bench Machine LearningEmotion RecognitionGenerative Adversarial Network+1Robust Federated Learning Against Adversarial Attacks for Speech Emotion Recognition
Due to the development of machine learning and speech processing, speech emotion recognition has been a popular research topic in recent years. However, the speech data cannot be protected when it is uploaded and process…
Emotion RecognitionFederated LearningSpeech Emotion RecognitionSpeech Emotion Recognition with Co-Attention based Multi-level Acoustic Information
Speech Emotion Recognition (SER) aims to help the machine to understand human's subjective emotion from only audio information. However, extracting and utilizing comprehensive in-depth audio information is still a challe…
Emotion RecognitionSpeech Emotion RecognitionSpeaker-invariant Affective Representation Learning via Adversarial Training
Representation learning for speech emotion recognition is challenging due to labeled data sparsity issue and lack of gold standard references. In addition, there is much variability from input speech signals, human subje…
Emotion ClassificationEmotion RecognitionRepresentation LearningSpeech Emotion RecognitionJELLY: Joint Emotion Recognition and Context Reasoning with LLMs for Conversational Speech Synthesis
Recently, there has been a growing demand for conversational speech synthesis (CSS) that generates more natural speech by considering the conversational context. To address this, we introduce JELLY, a novel CSS framework…
Emotion RecognitionLanguage ModelingLanguage ModellingLarge Language Model+1