paper-with-me

홈 › Papers

TGIF2: Extended Text-Guided Inpainting Forgery Dataset & Benchmark

2026-03-30 · Hannes Mareen, Dimitrios Karageorgiou, Paschalis Giakoumoglou, Peter Lambert, Symeon Papadopoulos, Glenn Van Wallendael arxiv

Generative AI has made text-guided inpainting a powerful image editing tool, but at the same time a growing challenge for media forensics. Existing benchmarks, including our text-guided inpainting forgery (TGIF) dataset, show that image forgery localization (IFL) methods can localize manipulations in spliced images but struggle not in fully regenerated (FR) images, while synthetic image detection (SID) methods can detect fully regenerated images but cannot perform localization. With new generative inpainting models emerging and the open problem of localization in FR images remaining, updated datasets and benchmarks are needed. We introduce TGIF2, an extended version of TGIF, that captures recent advances in text-guided inpainting and enables a deeper analysis of forensic robustness. TGIF2 augments the original dataset with edits generated by FLUX.1 models, as well as with random non-semantic masks. Using the TGIF2 dataset, we conduct a forensic evaluation spanning IFL and SID, including fine-tuning IFL methods on FR images and generative super-resolution attacks. Our experiments show that both IFL and SID methods degrade on FLUX.1 manipulations, highlighting limited generalization. Additionally, while fine-tuning improves localization on FR images, evaluation with random non-semantic masks reveals object bias. Furthermore, generative super-resolution significantly weakens forensic traces, demonstrating that common image enhancement operations can undermine current forensic pipelines. In summary, TGIF2 provides an updated dataset and benchmark, which enables new insights into the challenges posed by modern inpainting and AI-based image enhancements. TGIF2 is available at https://github.com/IDLabMedia/tgif-dataset.

📄 PDF Abstract BibTeX arXiv:2603.28613

Code (0)

등록된 구현이 없습니다.

Tasks

Image EnhancementImage Editing

Similar Papers 제목 키워드 기반

TGIF: Text-Guided Inpainting Forgery Dataset

2024-07-16 · Hannes Mareen, Dimitrios Karageorgiou, Glenn Van Wallendael, Peter Lambert 외

Digital image manipulation has become increasingly accessible and realistic with the advent of generative AI technologies. Recent developments allow for text-guided inpainting, making sophisticated image edits possible w…

Image ManipulationSynthetic Image Detection

Text-Guided Layer Fusion Mitigates Hallucination in Multimodal LLMs

2026-01-06 · Chenchen Lin, Sanbao Su, Rachel Luo, Yuxiao Chen 외 arxiv

Multimodal large language models (MLLMs) typically rely on a single late-layer feature from a frozen vision encoder, leaving the encoder's rich hierarchy of visual cues under-utilized. MLLMs still suffer from visually un…

Visual Grounding

EDGER: EDge-Guided with HEatmap Refinement for Generalizable Image Forgery Localization

2026-05-12 · Minh-Khoa Le-Phan, Minh-Hoang Le, Minh-Triet Tran, Trong-Le Do arxiv

Text-guided inpainting has made image forgery increasingly realistic, challenging both SID and IFL. However, existing methods often struggle to point out suspicious signals across domains. To address this problem, we pro…

Domain Generalization

Forensics Adapter: Unleashing CLIP for Generalizable Face Forgery Detection

2024-11-29 · Xinjie Cui, Yuezun Li, Delong Zhu, Jiaran Zhou 외

We describe Forensics Adapter, an adapter network designed to transform CLIP into an effective and generalizable face forgery detector. Although CLIP is highly versatile, adapting it for face forgery detection is non-tri…

Prompt Learning

Wavelet based inpainting detection

2024-08-12 · Barglazan Adrian-Alin, Brad Remus Ovidiu

With the advancement in image editing tools, manipulating digital images has become alarmingly easy. Inpainting, which is used to remove objects or fill in parts of an image, serves as a powerful tool for both image rest…

Image InpaintingImage RestorationImage SegmentationSemantic Segmentation