paper-with-me

홈 › Papers

EmoAttack: Utilizing Emotional Voice Conversion for Speech Backdoor Attacks on Deep Speech Classification Models

2024-08-28 · Wenhan Yao, Zedong XingXiarun Chen, Jia Liu, Yongqiang He, Weiping Wen

Deep speech classification tasks, mainly including keyword spotting and speaker verification, play a crucial role in speech-based human-computer interaction. Recently, the security of these technologies has been demonstrated to be vulnerable to backdoor attacks. Specifically speaking, speech samples are attacked by noisy disruption and component modification in present triggers. We suggest that speech backdoor attacks can strategically focus on emotion, a higher-level subjective perceptual attribute inherent in speech. Furthermore, we proposed that emotional voice conversion technology can serve as the speech backdoor attack trigger, and the method is called EmoAttack. Based on this, we conducted attack experiments on two speech classification tasks, showcasing that EmoAttack method owns impactful trigger effectiveness and its remarkable attack success rate and accuracy variance. Additionally, the ablation experiments found that speech with intensive emotion is more suitable to be targeted for attacks.

📄 PDF Abstract BibTeX arXiv:2408.15508

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeBackdoor AttackKeyword SpottingSpeaker VerificationVoice Conversion

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Limited Data Emotional Voice Conversion Leveraging Text-to-Speech: Two-stage Sequence-to-Sequence Training

2021-03-31 · Kun Zhou, Berrak Sisman, Haizhou Li

Emotional voice conversion (EVC) aims to change the emotional state of an utterance while preserving the linguistic content and speaker identity. In this paper, we propose a novel 2-stage training strategy for sequence-t…

text-to-speechText to SpeechVoice Conversion

Expressive Voice Conversion: A Joint Framework for Speaker Identity and Emotional Style Transfer

2021-07-08 · Zongyang Du, Berrak Sisman, Kun Zhou, Haizhou Li

Traditional voice conversion(VC) has been focused on speaker identity conversion for speech with a neutral expression. We note that emotional expression plays an essential role in daily communication, and the emotional s…

Emotion RecognitionSpeech Emotion RecognitionStyle TransferVoice Conversion

Emotional Voice Conversion: Theory, Databases and ESD

2021-05-31 · Kun Zhou, Berrak Sisman, Rui Liu, Haizhou Li

In this paper, we first provide a review of the state-of-the-art emotional voice conversion research, and the existing emotional speech databases. We then motivate the development of a novel emotional speech database (ES…

Voice Conversion

Towards Naturalistic Voice Conversion: NaturalVoices Dataset with an Automatic Processing Pipeline

2024-06-06 · Ali N. Salman, Zongyang Du, Shreeram Suresh Chandra, Ismail Rasim Ulgen 외

Voice conversion (VC) research traditionally depends on scripted or acted speech, which lacks the natural spontaneity of real-life conversations. While natural speech data is limited for VC, our study focuses on filling …

Voice Conversion

Attention-based Interactive Disentangling Network for Instance-level Emotional Voice Conversion

2023-12-29 · Yun Chen, Lingxiao Yang, Qi Chen, Jian-Huang Lai 외

Emotional Voice Conversion aims to manipulate a speech according to a given emotion while preserving non-emotion components. Existing approaches cannot well express fine-grained emotional attributes. In this paper, we pr…

Contrastive LearningDisentanglementVoice Conversion