EmoAttack: Utilizing Emotional Voice Conversion for Speech Backdoor Attacks on Deep Speech Classification Models
Deep speech classification tasks, mainly including keyword spotting and speaker verification, play a crucial role in speech-based human-computer interaction. Recently, the security of these technologies has been demonstrated to be vulnerable to backdoor attacks. Specifically speaking, speech samples are attacked by noisy disruption and component modification in present triggers. We suggest that speech backdoor attacks can strategically focus on emotion, a higher-level subjective perceptual attribute inherent in speech. Furthermore, we proposed that emotional voice conversion technology can serve as the speech backdoor attack trigger, and the method is called EmoAttack. Based on this, we conducted attack experiments on two speech classification tasks, showcasing that EmoAttack method owns impactful trigger effectiveness and its remarkable attack success rate and accuracy variance. Additionally, the ablation experiments found that speech with intensive emotion is more suitable to be targeted for attacks.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeBackdoor AttackKeyword SpottingSpeaker VerificationVoice ConversionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Limited Data Emotional Voice Conversion Leveraging Text-to-Speech: Two-stage Sequence-to-Sequence Training
Emotional voice conversion (EVC) aims to change the emotional state of an utterance while preserving the linguistic content and speaker identity. In this paper, we propose a novel 2-stage training strategy for sequence-t…
text-to-speechText to SpeechVoice ConversionExpressive Voice Conversion: A Joint Framework for Speaker Identity and Emotional Style Transfer
Traditional voice conversion(VC) has been focused on speaker identity conversion for speech with a neutral expression. We note that emotional expression plays an essential role in daily communication, and the emotional s…
Emotion RecognitionSpeech Emotion RecognitionStyle TransferVoice ConversionEmotional Voice Conversion: Theory, Databases and ESD
In this paper, we first provide a review of the state-of-the-art emotional voice conversion research, and the existing emotional speech databases. We then motivate the development of a novel emotional speech database (ES…
Voice ConversionTowards Naturalistic Voice Conversion: NaturalVoices Dataset with an Automatic Processing Pipeline
Voice conversion (VC) research traditionally depends on scripted or acted speech, which lacks the natural spontaneity of real-life conversations. While natural speech data is limited for VC, our study focuses on filling …
Voice ConversionAttention-based Interactive Disentangling Network for Instance-level Emotional Voice Conversion
Emotional Voice Conversion aims to manipulate a speech according to a given emotion while preserving non-emotion components. Existing approaches cannot well express fine-grained emotional attributes. In this paper, we pr…
Contrastive LearningDisentanglementVoice Conversion