Use of a Capsule Network to Detect Fake Images and Videos
The revolution in computer hardware, especially in graphics processing units and tensor processing units, has enabled significant advances in computer graphics and artificial intelligence algorithms. In addition to their many beneficial applications in daily life and business, computer-generated/manipulated images and videos can be used for malicious purposes that violate security systems, privacy, and social trust. The deepfake phenomenon and its variations enable a normal user to use his or her personal computer to easily create fake videos of anybody from a short real online video. Several countermeasures have been introduced to deal with attacks using such videos. However, most of them are targeted at certain domains and are ineffective when applied to other domains or new attacks. In this paper, we introduce a capsule network that can detect various kinds of attacks, from presentation attacks using printed images and replayed videos to attacks using fake videos created using deep learning. It uses many fewer parameters than traditional convolutional neural networks with similar performance. Moreover, we explain, for the first time ever in the literature, the theory behind the application of capsule networks to the forensics problem through detailed analysis and visualization.
Code (2)
Tasks
Image and Video Forgery DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Explainable Deepfake Video Detection using Convolutional Neural Network and CapsuleNet
Deepfake technology, derived from deep learning, seamlessly inserts individuals into digital media, irrespective of their actual participation. Its foundation lies in machine learning and Artificial Intelligence (AI). In…
Decision MakingFace SwappingGenerative Adversarial NetworkCapsule-Forensics: Using Capsule Networks to Detect Forged Images and Videos
Recent advances in media generation techniques have made it easier for attackers to create forged images and videos. State-of-the-art methods enable the real-time creation of a forged version of a single video obtained f…
Image and Video Forgery DetectionCapST: An Enhanced and Lightweight Model Attribution Approach for Synthetic Videos
Deepfake videos, generated through AI faceswapping techniques, have garnered considerable attention due to their potential for powerful impersonation attacks. While existing research primarily focuses on binary classific…
DecoderA Survey of Deep Fake Detection for Trial Courts
Recently, image manipulation has achieved rapid growth due to the advancement of sophisticated image editing tools. A recent surge of generated fake imagery and videos using neural networks is DeepFake. DeepFake algorith…
Face SwappingImage ManipulationSurveyDetecting Fake News with Capsule Neural Networks
Fake news is dramatically increased in social media in recent years. This has prompted the need for effective fake news detection algorithms. Capsule neural networks have been successful in computer vision and are receiv…
Fake News DetectionWord Embeddings