How Do Neural Spoofing Countermeasures Detect Partially Spoofed Audio?
Partially manipulating a sentence can greatly change its meaning. Recent work shows that countermeasures (CMs) trained on partially spoofed audio can effectively detect such spoofing. However, the current understanding of the decision-making process of CMs is limited. We utilize Grad-CAM and introduce a quantitative analysis metric to interpret CMs' decisions. We find that CMs prioritize the artifacts of transition regions created when concatenating bona fide and spoofed audio. This focus differs from that of CMs trained on fully spoofed audio, which concentrate on the pattern differences between bona fide and spoofed parts. Our further investigation explains the varying nature of CMs' focus while making correct or incorrect predictions. These insights provide a basis for the design of CM models and the creation of datasets. Moreover, this work lays a foundation of interpretability in the field of partial spoofed audio detection that has not been well explored previously.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
An Initial Investigation for Detecting Partially Spoofed Audio
All existing databases of spoofed speech contain attack data that is spoofed in its entirety. In practice, it is entirely plausible that successful attacks can be mounted with utterances that are only partially spoofed. …
Voice Anti-spoofingWaveform Boundary Detection for Partially Spoofed Audio
The present paper proposes a waveform boundary detection system for audio spoofing attacks containing partially manipulated segments. Partially spoofed/fake audio, where part of the utterance is replaced, either with syn…
Boundary DetectionPC-Mix: Partial-Component Audio Spoofing Detection under Mixed Speech and Environmental Sound Conditions
Recent studies on partial audio spoofing mainly focus on studio-recorded speech with temporal localization of spoofed segments. However, these studies often overlook realistic conditions where spoofed and bonafide segmen…
Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio
This paper defines Spoof Diarization as a novel task in the Partial Spoof (PS) scenario. It aims to determine what spoofed when, which includes not only locating spoof regions but also clustering them according to differ…
ClusteringASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
ASVspoof, now in its third edition, is a series of community-led challenges which promote the development of countermeasures to protect automatic speaker verification (ASV) from the threat of spoofing. Advances in the 20…
Speaker Verification