Image Operation Chain Detection with Machine Translation Framework
The aim of operation chain detection for a given manipulated image is to reveal the operations involved and the order in which they were applied, which is significant for image processing and multimedia forensics. Currently, all existing approaches simply treat image operation chain detection as a classification problem and consider only chains of at most two operations. Considering the complex interplay between operations and the exponentially increasing solution space, detecting longer operation chains is extremely challenging. To address this issue, in this work, we devise a new methodology for image operation chain detection. Different from existing approaches based on classification modeling, we strategically conduct operation chain detection within a machine translation framework. Specifically, the chain in our work is modeled as a sentence in a target language, with each possible operation represented by a word in that language. When executing chain detection, we propose first transforming the input image into a sentence in a latent source language from the learned deep features. Then, we propose translating the latent language into the target language within a machine translation framework and finally decoding all operations, arranged in order. Besides, a chain inversion strategy and a bi-directional modeling mechanism are developed to improve the detection performance. We further design a weighted cross-entropy loss to alleviate the problems presented by imbalance among chain lengths and chain categories. Our method can detect operation chains containing up to seven operations and obtains very promising results in various scenarios for the detection of both short and long chains.
Code (0)
등록된 구현이 없습니다.
Tasks
Image Operation Chain DetectionMachine TranslationSentenceSimilar Papers 제목 키워드 기반
Machine Learning and Blockchain for Fraud Detection: Employing Artificial Intelligence in the Banking Sector
Fraudulent banking operations can cause huge losses to the bank and further affect the economy negatively. What if Blockchain Technology and Machine Learning could be combined to detect suspicious banking activity and st…
BIG-bench Machine LearningFraud DetectionTMFNet: Two-Stream Multi-Channels Fusion Networks for Color Image Operation Chain Detection
Image operation chain detection techniques have gained increasing attention recently in the field of multimedia forensics. However, existing detection methods suffer from the generalization problem. Moreover, the channel…
Image Operation Chain DetectionKyoto-NMT: a Neural Machine Translation implementation in Chainer
We present Kyoto-NMT, an open-source implementation of the Neural Machine Translation paradigm. This implementation is done in Python and Chainer, an easy-to-use Deep Learning Framework.
Deep LearningLanguage ModelingLanguage ModellingMachine Translation+2Sketch-based Image Retrieval from Millions of Images under Rotation, Translation and Scale Variations
Proliferation of touch-based devices has made sketch-based image retrieval practical. While many methods exist for sketch-based object detection/image retrieval on small datasets, relatively less work has been done on la…
Image RetrievalObjectobject-detectionObject Detection+3Analysing Coreference in Transformer Outputs
We analyse coreference phenomena in three neural machine translation systems trained with different data settings with or without access to explicit intra- and cross-sentential anaphoric information. We compare system pe…
Machine TranslationTranslation