paper-with-me

Papers

WaveGuard: Understanding and Mitigating Audio Adversarial Examples

2021-03-04 · Shehzeen Hussain, Paarth Neekhara, Shlomo Dubnov, Julian McAuley, Farinaz Koushanfar

There has been a recent surge in adversarial attacks on deep learning based automatic speech recognition (ASR) systems. These attacks pose new challenges to deep learning security and have raised significant concerns in deploying ASR systems in safety-critical applications. In this work, we introduce WaveGuard: a framework for detecting adversarial inputs that are crafted to attack ASR systems. Our framework incorporates audio transformation functions and analyses the ASR transcriptions of the original and transformed audio to detect adversarial inputs. We demonstrate that our defense framework is able to reliably detect adversarial examples constructed by four recent audio adversarial attacks, with a variety of audio transformation functions. With careful regard for best practices in defense evaluations, we analyze our proposed defense and its strength to withstand adaptive and robust attacks in the audio domain. We empirically demonstrate that audio transformations that recover audio from perceptually informed representations can lead to a strong defense that is robust against an adaptive adversary even in a complete white-box setting. Furthermore, WaveGuard can be used out-of-the box and integrated directly with any ASR model to efficiently detect audio adversarial examples, without the need for model retraining.

📄 PDF Abstract BibTeX arXiv:2103.03344

Code (1)

shehzeen/waveguard_defense tf

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Similar Papers 제목 키워드 기반

Characterizing Audio Adversarial Examples Using Temporal Dependency

2018-09-28 · ICLR 2019 5 · Zhuolin Yang, Bo Li, Pin-Yu Chen, Dawn Song

Recent studies have highlighted adversarial examples as a ubiquitous threat to different neural network models and many downstream applications. Nonetheless, as unique data properties have inspired distinct and powerful …

Adversarial DefenseAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognition+1

WaveGuard: Robust Deepfake Detection and Source Tracing via Dual-Tree Complex Wavelet and Graph Neural Networks

2025-05-13 · Ziyuan He, Zhiqing Guo, Liejun Wang, Gaobo Yang 외

Deepfake technology poses increasing risks such as privacy invasion and identity theft. To address these threats, we propose WaveGuard, a proactive watermarking framework that enhances robustness and imperceptibility via…

DeepFake DetectionFace SwappingGraph Neural Network

Do Audio LLMs Listen or Read? Analyzing and Mitigating Paralinguistic Failures with VoxParadox

2026-05-26 · Jiacheng Pang, Ashutosh Chaubey, Mohammad Soleymani arxiv

Audio large language models (Audio LLMs) demonstrate strong performance on speech understanding tasks, yet their ability to understand paralinguistic information remains limited. To systematically quantify this issue, we…

Speech Synthesis

Synthesising Audio Adversarial Examples for Automatic Speech Recognition

2021-09-29 · Xinghua Qu, Pengfei Wei, Mingyong Gao, Zhu Sun 외

Adversarial examples in automatic speech recognition (ASR) are naturally sounded by humans yet capable of fooling well trained ASR models to transcribe incorrectly. Existing audio adversarial examples are typically const…

Audio SynthesisAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognition+1

Audio Adversarial Examples: Attacks Using Vocal Masks

2021-02-04 · Kai Yuan Tay, Lynnette Ng, Wei Han Chua, Lucerne Loke 외

We construct audio adversarial examples on automatic Speech-To-Text systems . Given any audio waveform, we produce an another by overlaying an audio vocal mask generated from the original audio. We apply our audio advers…

Adversarial AttackSpeech-to-Text