paper-with-me

홈 › Papers

The Unreasonable Effectiveness of Text Embedding Interpolation for Continuous Image Steering

2026-03-18 · Yigit Ekin, Yossi Gandelsman arxiv

We present a training-free framework for continuous and controllable image editing at test time for text-conditioned generative models. In contrast to prior approaches that rely on additional training or manual user intervention, we find that a simple steering in the text-embedding space is sufficient to produce smooth edit control. Given a target concept (e.g., enhancing photorealism or changing facial expression), we use a large language model to automatically construct a small set of debiased contrastive prompt pairs, from which we compute a steering vector in the generator's text-encoder space. We then add this vector directly to the input prompt representation to control generation along the desired semantic axis. To obtain a continuous control, we propose an elastic range search procedure that automatically identifies an effective interval of steering magnitudes, avoiding both under-steering (no-edit) and over-steering (changing other attributes). Adding the scaled versions of the same vector within this interval yields smooth and continuous edits. Since our method modifies only textual representations, it naturally generalizes across text-conditioned modalities, including image and video generation. To quantify the steering continuity, we introduce a new evaluation metric that measures the uniformity of semantic change across edit strengths. We compare the continuous editing behavior across methods and find that, despite its simplicity and lightweight design, our approach is comparable to training-based alternatives, outperforming other training-free methods.

📄 PDF Abstract BibTeX arXiv:2603.17998

Code (0)

등록된 구현이 없습니다.

Tasks

Continuous ControlVideo GenerationImage Editing

Similar Papers 제목 키워드 기반

The Unreasonable Effectiveness of Random Target Embeddings for Continuous-Output Neural Machine Translation

2023-10-31 · Evgeniia Tokarchuk, Vlad Niculae

Continuous-output neural machine translation (CoNMT) replaces the discrete next-word prediction problem with an embedding prediction. The semantic structure of the target embedding space (i.e., closeness of related words…

Machine TranslationPredictionTranslation

The Unreasonable Effectiveness of LLMs for Query Optimization

2024-11-05 · Peter Akioyamen, Zixuan Yi, Ryan Marcus

Recent work in database query optimization has used complex machine learning strategies, such as customized reinforcement learning schemes. Surprisingly, we show that LLM embeddings of query text contain useful semantic …

Positional Encoder Graph Neural Networks for Geographic Data

2021-11-19 · Konstantin Klemmer, Nathan Safir, Daniel B. Neill

Graph neural networks (GNNs) provide a powerful and scalable solution for modeling continuous spatial data. However, they often rely on Euclidean distances to construct the input graphs. This assumption can be improbable…

Gaussian ProcessesregressionSpatial Interpolation

Probabilistic Lexical Manifold Construction in Large Language Models via Hierarchical Vector Field Interpolation

2025-02-14 · Clive Pendleton, Ewan Harrington, Giles Fairbrother, Jasper Arkwright 외

Hierarchical vector field interpolation introduces a structured probabilistic framework for lexical representation, ensuring that word embeddings transition smoothly across a continuous manifold rather than being constra…

Computational EfficiencyRepresentation LearningWord Embeddings

Sobolev norm inconsistency of kernel interpolation

2025-04-29 · Yunfei Yang

We study the consistency of minimum-norm interpolation in reproducing kernel Hilbert spaces corresponding to bounded kernels. Our main result give lower bounds for the generalization error of the kernel interpolation mea…