Constrained R-CNN: A general image manipulation detection model
Recently, deep learning-based models have exhibited remarkable performance for image manipulation detection. However, most of them suffer from poor universality of handcrafted or predetermined features. Meanwhile, they only focus on manipulation localization and overlook manipulation classification. To address these issues, we propose a coarse-to-fine architecture named Constrained R-CNN for complete and accurate image forensics. First, the learnable manipulation feature extractor learns a unified feature representation directly from data. Second, the attention region proposal network effectively discriminates manipulated regions for the next manipulation classification and coarse localization. Then, the skip structure fuses low-level and high-level information to refine the global manipulation features. Finally, the coarse localization information guides the model to further learn the finer local features and segment out the tampered region. Experimental results show that our model achieves state-of-the-art performance. Especially, the F1 score is increased by 28.4%, 73.2%, 13.3% on the NIST16, COVERAGE, and Columbia dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationImage ForensicsImage ManipulationImage Manipulation DetectionImage Manipulation LocalizationRegion ProposalSimilar Papers 제목 키워드 기반
Constrained Convolutional Neural Networks: A New Approach Towards General Purpose Image Manipulation Detection
Identifying the authenticity and processing history of an image is an important task in multimedia forensics. By analyzing traces left by different image manipulations, researchers have been able to develop several alg…
Image ManipulationImage Manipulation DetectionNoise and Edge Based Dual Branch Image Manipulation Detection
Unlike ordinary computer vision tasks that focus more on the semantic content of images, the image manipulation detection task pays more attention to the subtle information of image manipulation. In this paper, the noise…
Edge DetectionImage ManipulationImage Manipulation DetectionL2-Constrained RemNet for Camera Model Identification and Image Manipulation Detection
Source camera model identification (CMI) and image manipulation detection are of paramount importance in image forensics. In this paper, we propose an L2-constrained Remnant Convolutional Neural Network (L2-constrained R…
General ClassificationImage ForensicsImage ManipulationImage Manipulation DetectionEffects of Image Compression on Face Image Manipulation Detection: A Case Study on Facial Retouching
In the past years, numerous methods have been introduced to reliably detect digital face image manipulations. Lately, the generalizability of these schemes has been questioned in particular with respect to image post-pro…
Image CompressionImage ManipulationImage Manipulation DetectionManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanation
With the rapid advancement of generative models, powerful image editing methods now enable diverse and highly realistic image manipulations that far surpass traditional deepfake techniques, posing new challenges for mani…
Image Manipulation DetectionImage Editing