A Skip Connection Architecture for Localization of Image Manipulations
Detection and localization of image manipulations are becoming of increasing interest to researchers in recent years due to the significant rise of malicious content-changing image tampering on the web. One of the major challenges for an image manipulation detection method is to discriminate between the tampered regions and other regions in an image. We observe that most of the manipulated images leave some traces near boundaries of manipulated regions including blurred edges. In order to exploit these traces in localizing the tampered regions, we propose an encoder-decoder based network where we fuse representations from early layers in the encoder (which are richer in low-level spatial cues, like edges) by skip pooling with representations of the last layer of the decoder and use for manipulation detection. In addition, we utilize resampling features extracted from patches of images by feeding them to LSTM cells to capture the transition between manipulated and non manipulated blocks in the frequency domain and combine the output of the LSTM with our encoder. The overall framework is capable of detecting different types of image manipulations simultaneously including copy-move, removal, and splicing. Experimental results on two standard benchmark datasets (CASIA 1.0 and NIST’16) demonstrate that the proposed method can achieve a significantly better performance than the state-of-the-art methods and baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderImage ManipulationImage Manipulation DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
M2SFormer: Multi-Spectral and Multi-Scale Attention with Edge-Aware Difficulty Guidance for Image Forgery Localization
Image editing techniques have rapidly advanced, facilitating both innovative use cases and malicious manipulation of digital images. Deep learning-based methods have recently achieved high accuracy in pixel-level forgery…
Rethinking Skip Connections in Spiking Neural Networks with Time-To-First-Spike Coding
Time-To-First-Spike (TTFS) coding in Spiking Neural Networks (SNNs) offers significant advantages in terms of energy efficiency, closely mimicking the behavior of biological neurons. In this work, we delve into the role …
Translated Skip Connections -- Expanding the Receptive Fields of Fully Convolutional Neural Networks
The effective receptive field of a fully convolutional neural network is an important consideration when designing an architecture, as it defines the portion of the input visible to each convolutional kernel. We propose …
Image SegmentationSegmentationSelf-Driving CarsSemantic SegmentationHybrid Skip: A Biologically Inspired Skip Connection for the UNet Architecture
In this work we introduce a biologically inspired long-range skip connection for the UNet architecture that relies on the perceptual illusion of hybrid images, being images that simultaneously encode two images. The fusi…
DecoderDepth EstimationDevelopment of Skip Connection in Deep Neural Networks for Computer Vision and Medical Image Analysis: A Survey
Deep learning has made significant progress in computer vision, specifically in image classification, object detection, and semantic segmentation. The skip connection has played an essential role in the architecture of d…
image-classificationImage ClassificationImage ReconstructionMedical Image Analysis+4