paper-with-me

Papers

LIPE: Learning Personalized Identity Prior for Non-rigid Image Editing

2024-06-25 · Aoyang Liu, Qingnan Fan, Shuai Qin, Hong Gu, Yansong Tang

Although recent years have witnessed significant advancements in image editing thanks to the remarkable progress of text-to-image diffusion models, the problem of non-rigid image editing still presents its complexities and challenges. Existing methods often fail to achieve consistent results due to the absence of unique identity characteristics. Thus, learning a personalized identity prior might help with consistency in the edited results. In this paper, we explore a novel task: learning the personalized identity prior for text-based non-rigid image editing. To address the problems in jointly learning prior and editing the image, we present LIPE, a two-stage framework designed to customize the generative model utilizing a limited set of images of the same subject, and subsequently employ the model with learned prior for non-rigid image editing. Experimental results demonstrate the advantages of our approach in various editing scenarios over past related leading methods in qualitative and quantitative ways.

📄 PDF Abstract BibTeX arXiv:2406.17236

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

FlexID: Training-Free Flexible Identity Injection via Intent-Aware Modulation for Text-to-Image Generation

2026-02-07 · Guandong Li, Yijun Ding arxiv

Personalized text-to-image generation aims to seamlessly integrate specific identities into textual descriptions. However, existing training-free methods often rely on rigid visual feature injection, creating a conflict …

Text-to-Image Generation

PERSONA: Personalized Whole-Body 3D Avatar with Pose-Driven Deformations from a Single Image

2025-08-13 · Geonhee Sim, Gyeongsik Moon arxiv

Two major approaches exist for creating animatable human avatars. The first, a 3D-based approach, optimizes a NeRF- or 3DGS-based avatar from videos of a single person, achieving personalization through a disentangled id…

Personalized Restoration via Dual-Pivot Tuning

2023-12-28 · Pradyumna Chari, Sizhuo Ma, Daniil Ostashev, Achuta Kadambi 외

Generative diffusion models can serve as a prior which ensures that solutions of image restoration systems adhere to the manifold of natural images. However, for restoring facial images, a personalized prior is necessary…

Image Restoration

CLIPer: Tailoring Diverse User Preference via Classifier-Guided Inference-Time Personalization

2026-05-08 · Jinyan Su, Jinpeng Zhou, Claire Cardie, Wen Sun arxiv

Personalized LLMs can significantly enhance user experiences by tailoring responses to preferences such as helpfulness, conciseness, and humor. However, fine-tuning models to address all possible combinations of user pre…

Personalized Residuals for Concept-Driven Text-to-Image Generation

2024-05-21 · CVPR 2024 1 · Cusuh Ham, Matthew Fisher, James Hays, Nicholas Kolkin 외

We present personalized residuals and localized attention-guided sampling for efficient concept-driven generation using text-to-image diffusion models. Our method first represents concepts by freezing the weights of a pr…

GPUImage GenerationText to Image GenerationText-to-Image Generation