paper-with-me

홈 › Papers

DeCorStory: Gram-Schmidt Prompt Embedding Decorrelation for Consistent Storytelling

2026-02-01 · Ayushman Sarkar, Zhenyu Yu, Mohd Yamani Idna Idris arxiv

Maintaining visual and semantic consistency across frames is a key challenge in text-to-image storytelling. Existing training-free methods, such as One-Prompt-One-Story, concatenate all prompts into a single sequence, which often induces strong embedding correlation and leads to color leakage, background blending, and identity drift. We propose DeCorStory, a training-free inference-time framework that explicitly reduces inter-frame semantic interference. DeCorStory applies Gram-Schmidt prompt embedding decorrelation to orthogonalize frame-level semantics, followed by singular value reweighting to strengthen prompt-specific information and identity-preserving cross-attention to stabilize character identity during diffusion. The method requires no model modification or fine-tuning and can be seamlessly integrated into existing diffusion pipelines. Experiments demonstrate consistent improvements in prompt-image alignment, identity consistency, and visual diversity, achieving state-of-the-art performance among training-free baselines. Code is available at: https://github.com/YuZhenyuLindy/DeCorStory

📄 PDF Abstract BibTeX arXiv:2602.01306

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Beyond Muon: MUD (MomentUm Decorrelation) for Faster Transformer Training

2026-03-18 · Ben S. Southworth, Stephen Thomas arxiv

Orthogonalized-momentum optimizers such as Muon improve transformer training by approximately whitening/orthogonalizing matrix-valued momentum updates via a short polar-decomposition iteration. However, polar-factor appr…

Protein Language Model

A Notion of Feature Importance by Decorrelation and Detection of Trends by Random Forest Regression

2023-03-02 · Yannick Gerstorfer, Lena Krieg, Max Hahn-Klimroth

In many studies, we want to determine the influence of certain features on a dependent variable. More specifically, we are interested in the strength of the influence -- i.e., is the feature relevant? -- and, if so, how …

Feature Importanceregression

New version of Gram-Schmidt Process with inverse for Signal and Image Processing

2016-07-16 · Mario Mastriani

The Gram-Schmidt Process (GSP) is used to convert a non-orthogonal basis (a set of linearly independent vectors, matrices, etc) into an orthonormal basis (a set of orthogonal, unit-length vectors, bi or tri dimensional m…

MoDAl: Self-Supervised Neural Modality Discovery via Decorrelation for Speech Neuroprosthesis

2026-04-22 · Yuanhao Chen, Peter Chin arxiv

Speech neuroprosthesis systems decode intended speech from neural activity in the absence of audible output, offering a path to restoring communication for individuals with speech-impairing conditions. Current approaches…

SCD: Self-Contrastive Decorrelation of Sentence Embeddings

2022-05-01 · ACL 2022 5 · Tassilo Klein, Moin Nabi

In this paper, we propose Self-Contrastive Decorrelation (SCD), a self-supervised approach. Given an input sentence, it optimizes a joint self-contrastive and decorrelation objective. Learning a representation is facilit…

Self-Supervised LearningSentenceSentence Embeddings