paper-with-me

Papers

CompBench: Benchmarking Complex Instruction-guided Image Editing

2025-05-18 · Bohan Jia, Wenxuan Huang, Yuntian Tang, Junbo Qiao, Jincheng Liao, Shaosheng Cao, Zhaopeng Feng, Zhouhong Gu, Zhenfei Yin, Lei Bai, Wanli Ouyang, Lin Chen, Fei Zhao, Zihan Wang, Yuan Xie, Shaohui Lin

While real-world applications increasingly demand intricate scene manipulation, existing instruction-guided image editing benchmarks often oversimplify task complexity and lack comprehensive, fine-grained instructions. To bridge this gap, we introduce, a large-scale benchmark specifically designed for complex instruction-guided image editing. CompBench features challenging editing scenarios that incorporate fine-grained instruction following, spatial and contextual reasoning, thereby enabling comprehensive evaluation of image editing models' precise manipulation capabilities. To construct CompBench, We propose an MLLM-human collaborative framework with tailored task pipelines. Furthermore, we propose an instruction decoupling strategy that disentangles editing intents into four key dimensions: location, appearance, dynamics, and objects, ensuring closer alignment between instructions and complex editing requirements. Extensive evaluations reveal that CompBench exposes fundamental limitations of current image editing models and provides critical insights for the development of next-generation instruction-guided image editing systems. The dataset, code, and models are available in https://comp-bench.github.io/.

📄 PDF Abstract BibTeX arXiv:2505.12200

Code (0)

등록된 구현이 없습니다.

Tasks

BenchmarkingInstruction Following

Similar Papers 제목 키워드 기반

Region-Constrained Group Relative Policy Optimization for Flow-Based Image Editing

2026-04-10 · Zhuohan Ouyang, Zhe Qian, Wenhuo Cui, Chaoqun Wang arxiv

Instruction-guided image editing requires balancing target modification with non-target preservation. Recently, flow-based models have emerged as a strong and increasingly adopted backbone for instruction-guided image ed…

Instruction FollowingImage Editing

T2I-CompBench: A Comprehensive Benchmark for Open-world Compositional Text-to-image Generation

2023-07-12 · NeurIPS 2023 11 · Kaiyi Huang, Kaiyue Sun, Enze Xie, Zhenguo Li 외

Despite the stunning ability to generate high-quality images by recent text-to-image models, current approaches often struggle to effectively compose objects with different attributes and relationships into a complex and…

AttributeImage GenerationText to Image GenerationText-to-Image Generation

Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generation

2026-05-19 · Junjie Wang, Xinghua Lou, Jason Li, Ye Tian 외 arxiv

Text-to-Image (T2I) models and Unified Multimodal Models (UMMs) have achieved remarkable progress in visual generation. However, their reliance on a single-pass generation paradigm limits their ability to handle complex …

MIRAGE: Benchmarking and Aligning Multi-Instance Image Editing

2026-04-06 · Ziqian Liu, Stephan Alaniz arxiv

Instruction-guided image editing has seen remarkable progress with models like FLUX.2 and Qwen-Image-Edit, yet they still struggle with complex scenarios with multiple similar instances each requiring individual edits. W…

Image Editing

ByteMorph: Benchmarking Instruction-Guided Image Editing with Non-Rigid Motions

2025-06-03 · Di Chang, Mingdeng Cao, Yichun Shi, Bo Liu 외

Editing images with instructions to reflect non-rigid motions, camera viewpoint shifts, object deformations, human articulations, and complex interactions, poses a challenging yet underexplored problem in computer vision…

BenchmarkingDiversity