Human Detection of Political Speech Deepfakes across Transcripts, Audio, and Video
Recent advances in technology for hyper-realistic visual and audio effects provoke the concern that deepfake videos of political speeches will soon be indistinguishable from authentic video recordings. The conventional wisdom in communication theory predicts people will fall for fake news more often when the same version of a story is presented as a video versus text. We conduct 5 pre-registered randomized experiments with 2,215 participants to evaluate how accurately humans distinguish real political speeches from fabrications across base rates of misinformation, audio sources, question framings, and media modalities. We find base rates of misinformation minimally influence discernment and deepfakes with audio produced by the state-of-the-art text-to-speech algorithms are harder to discern than the same deepfakes with voice actor audio. Moreover across all experiments, we find audio and visual information enables more accurate discernment than text alone: human discernment relies more on how something is said, the audio-visual cues, than what is said, the speech content.
Code (0)
등록된 구현이 없습니다.
Tasks
Face SwappingHuman DetectionMisinformationtext-to-speechText to SpeechSimilar Papers 제목 키워드 기반
Fit for Purpose? Deepfake Detection in the Real World
The rapid proliferation of AI-generated content, driven by advances in generative adversarial networks, diffusion models, and multimodal large language models, has made the creation and dissemination of synthetic media e…
DeepFake DetectionMeasuring the Robustness of Audio Deepfake Detectors
Deepfakes have become a universal and rapidly intensifying concern of generative AI across various media types such as images, audio, and videos. Among these, audio deepfakes have been of particular concern due to the ea…
Audio Deepfake DetectionData AugmentationDeepFake DetectionFace Swapping+1Recent Advancements In The Field Of Deepfake Detection
A deepfake is a photo or video of a person whose image has been digitally altered or partially replaced with an image of someone else. Deepfakes have the potential to cause a variety of problems and are often used malici…
DeepFake DetectionFace SwappingSurveyDeepfake Detection using Biological Features: A Survey
Deepfake is a deep learning-based technique that makes it easy to change or modify images and videos. In investigations and court, visual evidence is commonly employed, but these pieces of evidence may now be suspect due…
DeepFake DetectionFace SwappingGenerative Adversarial NetworkSurveyAnomaly Detection and Localization for Speech Deepfakes via Feature Pyramid Matching
The rise of AI-driven generative models has enabled the creation of highly realistic speech deepfakes - synthetic audio signals that can imitate target speakers' voices - raising critical security concerns. Existing meth…
Anomaly DetectionDeepFake DetectionFace Swapping