paper-with-me

홈 › Papers

Use of a Capsule Network to Detect Fake Images and Videos

2019-10-28 · Huy H. Nguyen, Junichi Yamagishi, Isao Echizen

The revolution in computer hardware, especially in graphics processing units and tensor processing units, has enabled significant advances in computer graphics and artificial intelligence algorithms. In addition to their many beneficial applications in daily life and business, computer-generated/manipulated images and videos can be used for malicious purposes that violate security systems, privacy, and social trust. The deepfake phenomenon and its variations enable a normal user to use his or her personal computer to easily create fake videos of anybody from a short real online video. Several countermeasures have been introduced to deal with attacks using such videos. However, most of them are targeted at certain domains and are ineffective when applied to other domains or new attacks. In this paper, we introduce a capsule network that can detect various kinds of attacks, from presentation attacks using printed images and replayed videos to attacks using fake videos created using deep learning. It uses many fewer parameters than traditional convolutional neural networks with similar performance. Moreover, we explain, for the first time ever in the literature, the theory behind the application of capsule networks to the forensics problem through detailed analysis and visualization.

📄 PDF Abstract BibTeX arXiv:1910.12467

Code (2)

nii-yamagishilab/Capsule-Forensics pytorch
nii-yamagishilab/Capsule-Forensics-v2 pytorch

Tasks

Image and Video Forgery Detection

Methods 이 논문이 사용한 방법론

Capsule Network A capsule is an activation vector that basically executes on its inputs some complex internal computations. Length of these activation vectors signifies the probability of…

Similar Papers 제목 키워드 기반

Explainable Deepfake Video Detection using Convolutional Neural Network and CapsuleNet

2024-04-19 · Gazi Hasin Ishrak, Zalish Mahmud, Md. Zami Al Zunaed Farabe, Tahera Khanom Tinni 외

Deepfake technology, derived from deep learning, seamlessly inserts individuals into digital media, irrespective of their actual participation. Its foundation lies in machine learning and Artificial Intelligence (AI). In…

Decision MakingFace SwappingGenerative Adversarial Network

Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videos

2018-10-26 · Huy H. Nguyen, Junichi Yamagishi, Isao Echizen

Recent advances in media generation techniques have made it easier for attackers to create forged images and videos. State-of-the-art methods enable the real-time creation of a forged version of a single video obtained f…

Image and Video Forgery Detection

CapST: An Enhanced and Lightweight Model Attribution Approach for Synthetic Videos

2023-11-07 · Wasim Ahmad, Yan-Tsung Peng, Yuan-Hao Chang, Gaddisa Olani Ganfure 외

Deepfake videos, generated through AI faceswapping techniques, have garnered considerable attention due to their potential for powerful impersonation attacks. While existing research primarily focuses on binary classific…

Decoder

A Survey of Deep Fake Detection for Trial Courts

2022-05-31 · Naciye Celebi, Qingzhong Liu, Muhammed Karatoprak

Recently, image manipulation has achieved rapid growth due to the advancement of sophisticated image editing tools. A recent surge of generated fake imagery and videos using neural networks is DeepFake. DeepFake algorith…

Face SwappingImage ManipulationSurvey

Detecting Fake News with Capsule Neural Networks

2020-02-03 · Mohammad Hadi Goldani, Saeedeh Momtazi, Reza Safabakhsh

Fake news is dramatically increased in social media in recent years. This has prompted the need for effective fake news detection algorithms. Capsule neural networks have been successful in computer vision and are receiv…

Fake News DetectionWord Embeddings