paper-with-me

Papers

Zero-Shot Visual Concept Blending Without Text Guidance

2025-03-27 · Hiroya Makino, Takahiro Yamaguchi, Hiroyuki Sakai

We propose a novel, zero-shot image generation technique called "Visual Concept Blending" that provides fine-grained control over which features from multiple reference images are transferred to a source image. If only a single reference image is available, it is difficult to isolate which specific elements should be transferred. However, using multiple reference images, the proposed approach distinguishes between common and unique features by selectively incorporating them into a generated output. By operating within a partially disentangled Contrastive Language-Image Pre-training (CLIP) embedding space (from IP-Adapter), our method enables the flexible transfer of texture, shape, motion, style, and more abstract conceptual transformations without requiring additional training or text prompts. We demonstrate its effectiveness across a diverse range of tasks, including style transfer, form metamorphosis, and conceptual transformations, showing how subtle or abstract attributes (e.g., brushstroke style, aerodynamic lines, and dynamism) can be seamlessly combined into a new image. In a user study, participants accurately recognized which features were intended to be transferred. Its simplicity, flexibility, and high-level control make Visual Concept Blending valuable for creative fields such as art, design, and content creation, where combining specific visual qualities from multiple inspirations is crucial.

📄 PDF Abstract BibTeX arXiv:2503.21277

Code (1)

ToyotaCRDL/Visual-Concept-Blending 공식 구현 pytorch

Tasks

Image GenerationStyle Transfer

Similar Papers 제목 키워드 기반

ZeroC: A Neuro-Symbolic Model for Zero-shot Concept Recognition and Acquisition at Inference Time

2022-06-30 · Tailin Wu, Megan Tjandrasuwita, Zhengxuan Wu, Xuelin Yang 외

Humans have the remarkable ability to recognize and acquire novel visual concepts in a zero-shot manner. Given a high-level, symbolic description of a novel concept in terms of previously learned visual concepts and thei…

Novel Concepts

Z-SASLM: Zero-Shot Style-Aligned SLI Blending Latent Manipulation

2025-03-29 · CVPR 2025 Workshop AI for Creative Visual Content Generation Editing and Understanding 2025 4 · Alessio Borgi, Luca Maiano, Irene Amerini

We introduce Z-SASLM, a Zero-Shot Style-Aligned SLI (Spherical Linear Interpolation) Blending Latent Manipulation pipeline that overcomes the limitations of current multi-style blending methods. Conventional approaches r…

Layered Rendering Diffusion Model for Controllable Zero-Shot Image Synthesis

2023-11-30 · Zipeng Qi, Guoxi Huang, Chenyang Liu, Fei Ye

This paper introduces innovative solutions to enhance spatial controllability in diffusion models reliant on text queries. We first introduce vision guidance as a foundational spatial cue within the perturbed distributio…

DenoisingImage Generation

Help Me Identify: Is an LLM+VQA System All We Need to Identify Visual Concepts?

2024-10-17 · Shailaja Keyur Sampat, Maitreya Patel, Yezhou Yang, Chitta Baral

An ability to learn about new objects from a small amount of visual data and produce convincing linguistic justification about the presence/absence of certain concepts (that collectively compose the object) in novel scen…

AllLanguage ModelingLanguage ModellingLarge Language Model+4

FateZero: Fusing Attentions for Zero-shot Text-based Video Editing

2023-03-16 · ICCV 2023 1 · Chenyang Qi, Xiaodong Cun, Yong Zhang, Chenyang Lei 외

The diffusion-based generative models have achieved remarkable success in text-based image generation. However, since it contains enormous randomness in generation progress, it is still challenging to apply such models f…

AttributeText-to-Video EditingVideo EditingVideo Style Transfer