paper-with-me

Papers

Personalized Image Editing in Text-to-Image Diffusion Models via Collaborative Direct Preference Optimization

2025-11-06 · Connor Dunlop, Matthew Zheng, Kavana Venkatesh, Pinar Yanardag arxiv

Text-to-image (T2I) diffusion models have made remarkable strides in generating and editing high-fidelity images from text. Yet, these models remain fundamentally generic, failing to adapt to the nuanced aesthetic preferences of individual users. In this work, we present the first framework for personalized image editing in diffusion models, introducing Collaborative Direct Preference Optimization (C-DPO), a novel method that aligns image edits with user-specific preferences while leveraging collaborative signals from like-minded individuals. Our approach encodes each user as a node in a dynamic preference graph and learns embeddings via a lightweight graph neural network, enabling information sharing across users with overlapping visual tastes. We enhance a diffusion model's editing capabilities by integrating these personalized embeddings into a novel DPO objective, which jointly optimizes for individual alignment and neighborhood coherence. Comprehensive experiments, including user studies and quantitative benchmarks, demonstrate that our method consistently outperforms baselines in generating edits that are aligned with user preferences.

📄 PDF Abstract BibTeX arXiv:2511.05616

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural NetworkImage Editing

Similar Papers 제목 키워드 기반

DreamSteerer: Enhancing Source Image Conditioned Editability using Personalized Diffusion Models

2024-10-15 · Zhengyang Yu, Zhaoyuan Yang, Jing Zhang

Recent text-to-image personalization methods have shown great promise in teaching a diffusion model user-specified concepts given a few images for reusing the acquired concepts in a novel context. With massive efforts be…

Denoising

Energy-Guided Optimization for Personalized Image Editing with Pretrained Text-to-Image Diffusion Models

2025-03-06 · Rui Jiang, Xinghe Fu, Guangcong Zheng, Teng Li 외

The rapid advancement of pretrained text-driven diffusion models has significantly enriched applications in image generation and editing. However, as the demand for personalized content editing increases, new challenges …

Image GenerationObject

LIPE: Learning Personalized Identity Prior for Non-rigid Image Editing

2024-06-25 · Aoyang Liu, Qingnan Fan, Shuai Qin, Hong Gu 외

Although recent years have witnessed significant advancements in image editing thanks to the remarkable progress of text-to-image diffusion models, the problem of non-rigid image editing still presents its complexities a…

CatVersion: Concatenating Embeddings for Diffusion-Based Text-to-Image Personalization

2023-11-24 · Ruoyu Zhao, Mingrui Zhu, Shiyin Dong, Nannan Wang 외

We propose CatVersion, an inversion-based method that learns the personalized concept through a handful of examples. Subsequently, users can utilize text prompts to generate images that embody the personalized concept, t…

Image GenerationPersonalized Image Generation

Dense-Face: Personalized Face Generation Model via Dense Annotation Prediction

2024-12-24 · Xiao Guo, Manh Tran, Jiaxin Cheng, Xiaoming Liu

The text-to-image (T2I) personalization diffusion model can generate images of the novel concept based on the user input text caption. However, existing T2I personalized methods either require test-time fine-tuning or fa…

Face GenerationImage Generation