Towards generalisable and calibrated synthetic speech detection with self-supervised representations
Generalisation -- the ability of a model to perform well on unseen data -- is crucial for building reliable deepfake detectors. However, recent studies have shown that the current audio deepfake models fall short of this desideratum. In this work we investigate the potential of pretrained self-supervised representations in building general and calibrated audio deepfake detection models. We show that large frozen representations coupled with a simple logistic regression classifier are extremely effective in achieving strong generalisation capabilities: compared to the RawNet2 model, this approach reduces the equal error rate from 30.9% to 8.8% on a benchmark of eight deepfake datasets, while learning less than 2k parameters. Moreover, the proposed method produces considerably more reliable predictions compared to previous approaches making it more suitable for realistic use.
Code (0)
등록된 구현이 없습니다.
Tasks
2kAudio Deepfake DetectionDeepFake DetectionFace SwappingSynthetic Speech DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards generalisable hate speech detection: a review on obstacles and solutions
Hate speech is one type of harmful online content which directly attacks or promotes hate towards a group or an individual member based on their actual or perceived aspects of identity, such as ethnicity, religion, and s…
Hate Speech DetectionRobust Hate Speech Detection in Social Media: A Cross-Dataset Empirical Evaluation
The automatic detection of hate speech online is an active research area in NLP. Most of the studies to date are based on social media datasets that contribute to the creation of hate speech detection models trained on t…
Hate Speech DetectionImpact of ASR on Alzheimer's Disease Detection: All Errors are Equal, but Deletions are More Equal than Others
Automatic Speech Recognition (ASR) is a critical component of any fully-automated speech-based dementia detection model. However, despite years of speech recognition research, little is known about the impact of ASR accu…
AllAlzheimer's Disease DetectionAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)+2Impact of ASR on Alzheimer’s Disease Detection: All Errors are Equal, but Deletions are More Equal than Others
Automatic Speech Recognition (ASR) is a critical component of any fully-automated speech-based dementia detection model. However, despite years of speech recognition research, little is known about the impact of ASR accu…
AllAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognition+1HateCheck: Functional Tests for Hate Speech Detection Models
Detecting online hate is a difficult task that even state-of-the-art models struggle with. Typically, hate speech detection models are evaluated by measuring their performance on held-out test data using metrics such as …
DiagnosticHate Speech Detection