A Lightweight and Effective Image Tampering Localization Network with Vision Mamba
Current image tampering localization methods primarily rely on Convolutional Neural Networks (CNNs) and Transformers. While CNNs suffer from limited local receptive fields, Transformers offer global context modeling at the expense of quadratic computational complexity. Recently, the state space model Mamba has emerged as a competitive alternative, enabling linear-complexity global dependency modeling. Inspired by it, we propose a lightweight and effective FORensic network based on vision MAmba (ForMa) for blind image tampering localization. Firstly, ForMa captures multi-scale global features that achieves efficient global dependency modeling through linear complexity. Then the pixel-wise localization map is generated by a lightweight decoder, which employs a parameter-free pixel shuffle layer for upsampling. Additionally, a noise-assisted decoding strategy is proposed to integrate complementary manipulation traces from tampered images, boosting decoder sensitivity to forgery cues. Experimental results on 10 standard datasets demonstrate that ForMa achieves state-of-the-art generalization ability and robustness, while maintaining the lowest computational complexity. Code is available at https://github.com/multimediaFor/ForMa.
Code (1)
Tasks
DecoderMambaMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
UnionFormer: Unified-Learning Transformer with Multi-View Representation for Image Manipulation Detection and Localization
We present UnionFormer a novel framework that integrates tampering clues across three views by unified learning for image manipulation detection and localization. Specifically we construct a BSFI-Net to extract tampe…
Image ManipulationImage Manipulation DetectionReLoc: A Restoration-Assisted Framework for Robust Image Tampering Localization
With the spread of tampered images, locating the tampered regions in digital images has drawn increasing attention. The existing image tampering localization methods, however, suffer from severe performance degradation w…
Image RestorationStableGuard: Towards Unified Copyright Protection and Tamper Localization in Latent Diffusion Models
The advancement of diffusion models has enhanced the realism of AI-generated content but also raised concerns about misuse, necessitating robust copyright protection and tampering localization. Although recent methods ha…
Effective Image Tampering Localization with Multi-Scale ConvNeXt Feature Fusion
With the widespread use of powerful image editing tools, image tampering becomes easy and realistic. Existing image forensic methods still face challenges of low generalization performance and robustness. In this letter,…
Data AugmentationDecoderSemantic SegmentationPerceptual MAE for Image Manipulation Localization: A High-level Vision Learner Focusing on Low-level Features
Nowadays, multimedia forensics faces unprecedented challenges due to the rapid advancement of multimedia generation technology thereby making Image Manipulation Localization (IML) crucial in the pursuit of truth. The key…
Image ManipulationImage Manipulation Localization