paper-with-me

홈 › Papers

EditHF-1M: A Million-Scale Rich Human Preference Feedback for Image Editing

2026-03-16 · Zitong Xu, Huiyu Duan, Zhongpeng Ji, Xinyun Zhang, Yutao Liu, Xiongkuo Min, Ke Gu, Jian Zhang, Shusong Xu, Jinwei Chen, Bo Li, Guangtao Zhai arxiv

Recent text-guided image editing (TIE) models have achieved remarkable progress, while many edited images still suffer from issues such as artifacts, unexpected editings, unaesthetic contents. Although some benchmarks and methods have been proposed for evaluating edited images, scalable evaluation models are still lacking, which limits the development of human feedback reward models for image editing. To address the challenges, we first introduce \textbf{EditHF-1M}, a million-scale image editing dataset with over 29M human preference pairs and 148K human mean opinion ratings, both evaluated from three dimensions, \textit{i.e.}, visual quality, instruction alignment, and attribute preservation. Based on EditHF-1M, we propose \textbf{EditHF}, a multimodal large language model (MLLM) based evaluation model, to provide human-aligned feedback from image editing. Finally, we introduce \textbf{EditHF-Reward}, which utilizes EditHF as the reward signal to optimize the text-guided image editing models through reinforcement learning. Extensive experiments show that EditHF achieves superior alignment with human preferences and demonstrates strong generalization on other datasets. Furthermore, we fine-tune the Qwen-Image-Edit using EditHF-Reward, achieving significant performance improvements, which demonstrates the ability of EditHF to serve as a reward model to scale-up the image editing. Both the dataset and code will be released in our GitHub repository: https://github.com/IntMeGroup/EditHF.

📄 PDF Abstract BibTeX arXiv:2603.14916

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningImage Editing

Similar Papers 제목 키워드 기반

Skywork-Reward-V2: Scaling Preference Data Curation via Human-AI Synergy

2025-07-02 · Chris Yuhao Liu, Liang Zeng, Yuzhen Xiao, Jujie He 외 arxiv

Despite the critical role of reward models (RMs) in Reinforcement Learning from Human Feedback (RLHF), current state-of-the-art open RMs perform poorly on most existing evaluation benchmarks, failing to capture nuanced h…

Reinforcement Learning

Humor in AI: Massive Scale Crowd-Sourced Preferences and Benchmarks for Cartoon Captioning

2024-06-15 · Jifan Zhang, Lalit Jain, Yang Guo, Jiayi Chen 외

We present a novel multimodal preference dataset for creative tasks, consisting of over 250 million human ratings on more than 2.2 million captions, collected through crowdsourcing rating data for The New Yorker's weekly…

Caption Generation

ASER: Towards Large-scale Commonsense Knowledge Acquisition via Higher-order Selectional Preference over Eventualities

2021-04-05 · Hongming Zhang, Xin Liu, Haojie Pan, Haowen Ke 외

Commonsense knowledge acquisition and reasoning have long been a core artificial intelligence problem. However, in the past, there has been a lack of scalable methods to collect commonsense knowledge. In this paper, we p…

Discourse Parsing

Scalable Ranked Preference Optimization for Text-to-Image Generation

2024-10-23 · Shyamgopal Karthik, Huseyin Coskun, Zeynep Akata, Sergey Tulyakov 외

Direct Preference Optimization (DPO) has emerged as a powerful approach to align text-to-image (T2I) models with human feedback. Unfortunately, successful application of DPO to T2I models requires a huge amount of resour…

Image GenerationText to Image GenerationText-to-Image Generation

Large-scale Reinforcement Learning for Diffusion Models

2024-01-20 · Yinan Zhang, Eric Tzeng, Yilun Du, Dmitry Kislyuk

Text-to-image diffusion models are a class of deep generative models that have demonstrated an impressive capacity for high-quality image generation. However, these models are susceptible to implicit biases that arise fr…

DiversityEthicsFairnessImage Generation+3