Constrained Convolutional Neural Networks: A New Approach Towards General Purpose Image Manipulation Detection
Identifying the authenticity and processing history of an image is an important task in multimedia forensics. By analyzing traces left by different image manipulations, researchers have been able to develop several algorithms capable of detecting targeted editing operations. While this approach has led to the development of several successful forensic algorithms, an important problem remains: creating forensic detectors for different image manipulations is a difficult and time consuming process. Furthermore, forensic analysts need ‘general purpose’ forensic algorithms capable of detecting multiple different image manipulations. In this paper, we address both of these problems by proposing a new general purpose forensic approach using convolutional neural networks (CNNs). While CNNs are capable of learning classification features directly from data, in their existing form they tend to learn features representative of an image’s content. To overcome this issue, we have developed a new type of CNN layer, called a constrained convolutional layer, that is able to jointly suppress an image’s content and adaptively learn manipulation detection features. Through a series of experiments, we show that our proposed constrained CNN is able to learn manipulation detection features directly from data. Our experimental results demonstrate that our CNN can detect multiple different editing operations with up to 99.97% accuracy and outperform the existing state-of-the-art general purpose manipulation detector. Furthermore, our constrained CNN can still accurately detect image manipulations in realistic scenarios where there is a source camera model mismatch between the training and testing data
Code (0)
등록된 구현이 없습니다.
Tasks
Image ManipulationImage Manipulation DetectionSimilar Papers 제목 키워드 기반
L2-Constrained RemNet for Camera Model Identification and Image Manipulation Detection
Source camera model identification (CMI) and image manipulation detection are of paramount importance in image forensics. In this paper, we propose an L2-constrained Remnant Convolutional Neural Network (L2-constrained R…
General ClassificationImage ForensicsImage ManipulationImage Manipulation DetectionOff-the-shelf Vision Models Benefit Image Manipulation Localization
Image manipulation localization (IML) and general vision tasks are typically treated as two separate research directions due to the fundamental differences between manipulation-specific and semantic features. In this pap…
Image Manipulation LocalizationImage GenerationOneVLA: A Unified Framework for Embodied Tasks
Navigation and manipulation are fundamental capabilities of embodied intelligence, enabling robots to interpret natural language commands and interact physically with their surroundings. However, current Vision-Language-…
Constrained R-CNN: A general image manipulation detection model
Recently, deep learning-based models have exhibited remarkable performance for image manipulation detection. However, most of them suffer from poor universality of handcrafted or predetermined features. Meanwhile, they o…
General ClassificationImage ForensicsImage ManipulationImage Manipulation Detection+2Seeing eye-to-eye? A comparison of object recognition performance in humans and deep convolutional neural networks under image manipulation
For a considerable time, deep convolutional neural networks (DCNNs) have reached human benchmark performance in object recognition. On that account, computational neuroscience and the field of machine learning have start…
AttributeImage ManipulationObjectObject Recognition