TriPINet: Tripartite Progressive Integration Network for Image Manipulation Localization
Image manipulation localization aims at distinguishing forged regions from the whole test image. Although many outstanding prior arts have been proposed for this task, there are still two issues that need to be further studied: 1) how to fuse diverse types of features with forgery clues; 2) how to progressively integrate multistage features for better localization performance. In this paper, we propose a tripartite progressive integration network (TriPINet) for end-to-end image manipulation localization. First, we extract both visual perception information, e.g., RGB input images, and visual imperceptible features, e.g., frequency and noise traces for forensic feature learning. Second, we develop a guided cross-modality dual-attention (gCMDA) module to fuse different types of forged clues. Third, we design a set of progressive integration squeeze-and-excitation (PI-SE) modules to improve localization performance by appropriately incorporating multiscale features in the decoder. Extensive experiments are conducted to compare our method with state-of-the-art image forensics approaches. The proposed TriPINet obtains competitive results on several benchmark datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderImage ForensicsImage ManipulationImage Manipulation LocalizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Tripartite Information Mining and Integration for Image Matting
With the development of deep convolutional neural networks, image matting has ushered in a new phase. Regarding the nature of image matting, most researches have focused on solutions for transition regions. However, …
2kImage MattingPRISM: Progressive Restoration for Scene Graph-based Image Manipulation
Scene graphs have emerged as accurate descriptive priors for image generation and manipulation tasks, however, their complexity and diversity of the shapes and relations of objects in data make it challenging to incorpor…
DenoisingDescriptiveDiversityImage Generation+1PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localization
To defend against manipulation of image content, such as splicing, copy-move, and removal, we develop a Progressive Spatio-Channel Correlation Network (PSCC-Net) to detect and localize image manipulations. PSCC-Net proce…
DecoderImage ManipulationImage Manipulation DetectionImage Manipulation LocalizationTriNE: Network Representation Learning for Tripartite Heterogeneous Networks
In this paper, we study network representation learning for tripartite heterogeneous networks which learns node representation features for networks with three types of node entities. We argue that tripartite networks ar…
Network EmbeddingRepresentation LearningTAGPsycholinguistic Tripartite Graph Network for Personality Detection
Most of the recent work on personality detection from online posts adopts multifarious deep neural networks to represent the posts and builds predictive models in a data-driven manner, without the exploitation of psychol…
Graph AttentionGraph Learning