SpaceEdit: Learning a Unified Editing Space for Open-Domain Image Color Editing
Recently, large pretrained models (e.g., BERT, StyleGAN, CLIP) show great knowledge transfer and generalization capability on various downstream tasks within their domains. Inspired by these efforts, in this paper we propose a unified model for open-domain image editing focusing on color and tone adjustment of open-domain images while keeping their original content and structure. Our model learns a unified editing space that is more semantic, intuitive, and easy to manipulate than the operation space (e.g., contrast, brightness, color curve) used in many existing photo editing softwares. Our model belongs to the image-to-image translation framework which consists of an image encoder and decoder, and is trained on pairs of before-and-after edited images to produce multimodal outputs. We show that by inverting image pairs into latent codes of the learned editing space, our model can be leveraged for various downstream editing tasks such as language-guided image editing, personalized editing, editing-style clustering, retrieval, etc. We extensively study the unique properties of the editing space in experiments and demonstrate superior performance on the aforementioned tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderImage-to-Image TranslationRetrievalTransfer LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SpaceEdit: Learning a Unified Editing Space for Open-Domain Image Editing
Recently, large pretrained models (e.g., BERT, StyleGAN, CLIP) have shown great knowledge transfer and generalization capability on various downstream tasks within their domains. Inspired by these efforts, in this paper …
DecoderImage-to-Image TranslationRetrievalTransfer LearningSpaceEditing: Integrating Human Knowledge into Deep Neural Networks via Interactive Latent Space Editing
We propose an interactive editing method that allows humans to help deep neural networks (DNNs) learn a latent space more consistent with human knowledge, thereby improving classification accuracy on indistinguishable am…
Dimensionality ReductionUniEdit: A Unified Knowledge Editing Benchmark for Large Language Models
Model editing aims to enhance the accuracy and reliability of large language models (LLMs) by efficiently adjusting their internal parameters. Currently, most LLM editing datasets are confined to narrow knowledge domains…
Diversityknowledge editingKnowledge GraphsModel EditingS1-Omni-Image: A Unified Model for Scientific Image Understanding, Generation, and Editing
We present S1-Omni-Image, an open-weight unified multimodal model for scientific image understanding, generation, and editing. Unlike general-purpose image generation models, scientific image tasks require not only high-…
Image Super-ResolutionMultimodal ReasoningImage SegmentationImage GenerationUniEdit-I: Training-free Image Editing for Unified VLM via Iterative Understanding, Editing and Verifying
While Unified Vision-Language Models promise to synergistically combine the high-level semantic understanding of vision-language models with the generative fidelity of diffusion models, current editing methodologies rema…
Image Editing