paper-with-me

홈 › Papers

SVDD Challenge 2024: A Singing Voice Deepfake Detection Challenge Evaluation Plan

2024-05-08 · You Zhang, Yongyi Zang, Jiatong Shi, Ryuichi Yamamoto, Jionghao Han, Yuxun Tang, Tomoki Toda, Zhiyao Duan

The rapid advancement of AI-generated singing voices, which now closely mimic natural human singing and align seamlessly with musical scores, has led to heightened concerns for artists and the music industry. Unlike spoken voice, singing voice presents unique challenges due to its musical nature and the presence of strong background music, making singing voice deepfake detection (SVDD) a specialized field requiring focused attention. To promote SVDD research, we recently proposed the "SVDD Challenge," the very first research challenge focusing on SVDD for lab-controlled and in-the-wild bonafide and deepfake singing voice recordings. The challenge will be held in conjunction with the 2024 IEEE Spoken Language Technology Workshop (SLT 2024).

📄 PDF Abstract BibTeX arXiv:2405.05244

Code (1)

svddchallenge/ctrsvdd2024_baseline 공식 구현 pytorch

Tasks

DeepFake DetectionFace Swapping

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

SVDD 2024: The Inaugural Singing Voice Deepfake Detection Challenge

2024-08-28 · You Zhang, Yongyi Zang, Jiatong Shi, Ryuichi Yamamoto 외

With the advancements in singing voice generation and the growing presence of AI singers on media platforms, the inaugural Singing Voice Deepfake Detection (SVDD) Challenge aims to advance research in identifying AI-gene…

DeepFake DetectionFace SwappingSinging Voice Synthesis

Speech Foundation Model Ensembles for the Controlled Singing Voice Deepfake Detection (CtrSVDD) Challenge 2024

2024-09-03 · Anmol Guragain, Tianchi Liu, Zihan Pan, Hardik B. Sailor 외

This work details our approach to achieving a leading system with a 1.79% pooled equal error rate (EER) on the evaluation set of the Controlled Singing Voice Deepfake Detection (CtrSVDD). The rapid advancement of generat…

DeepFake DetectionFace SwappingVoice Anti-spoofing

CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detection

2024-06-04 · Yongyi Zang, Jiatong Shi, You Zhang, Ryuichi Yamamoto 외

Recent singing voice synthesis and conversion advancements necessitate robust singing voice deepfake detection (SVDD) models. Current SVDD datasets face challenges due to limited controllability, diversity in deepfake me…

DeepFake DetectionDiversityFace Swappingfeature selection+1

Deepfake Detection of Singing Voices With Whisper Encodings

2025-01-31 · Falguni Sharma, Priyanka Gupta

The deepfake generation of singing vocals is a concerning issue for artists in the music industry. In this work, we propose a singing voice deepfake detection (SVDD) system, which uses noise-variant encodings of open-AI'…

DeepFake DetectionFace Swapping

Are Music Foundation Models Better at Singing Voice Deepfake Detection? Far-Better Fuse them with Speech Foundation Models

2024-09-21 · Orchid Chetia Phukan, Sarthak Jain, Swarup Ranjan Behera, Arun Balaji Buduru 외

In this study, for the first time, we extensively investigate whether music foundation models (MFMs) or speech foundation models (SFMs) work better for singing voice deepfake detection (SVDD), which has recently attracte…

DeepFake DetectionFace SwappingRepresentation LearningSpeaker Recognition+1