paper-with-me

홈 › Papers

NumColor: Precise Numeric Color Control in Text-to-Image Generation

2026-03-13 · Muhammad Atif Butt, Diego Hernandez, Alexandra Gomez-Villa, Kai Wang, Javier Vazquez-Corral, Joost Van De Weijer arxiv

Text-to-image diffusion models excel at generating images from natural language descriptions, yet fail to interpret numerical colors such as hex codes (#FF5733) and RGB values (rgb(255,87,51)). This limitation stems from subword tokenization, which fragments color codes into semantically meaningless tokens that text encoders cannot map to coherent color representations. We present NumColor, that enables precise numerical color control across multiple diffusion architectures. NumColor comprises two components: a Color Token Aggregator that detects color specifications regardless of tokenization, and a ColorBook containing 6,707 learnable embeddings that map colors to embedding space of text encoder in perceptually uniform CIE Lab space. We introduce two auxiliary losses, directional alignment and interpolation consistency, to enforce geometric correspondence between Lab and embedding spaces, enabling smooth color interpolation. To train the ColorBook, we construct NumColor-Data, a synthetic dataset of 500K rendered images with unambiguous color-to-pixel correspondence, eliminating the annotation ambiguity inherent in photographic datasets. Although trained solely on FLUX, NumColor transfers zero-shot to SD3, SD3.5, PixArt-α, and PixArt-Σ without model-specific adaptation. NumColor improves numerical color accuracy by 4-9x across five models, while simultaneously improving color harmony scores by 10-30x on GenColorBench benchmark.

📄 PDF Abstract BibTeX arXiv:2603.13547

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Image Generation

Similar Papers 제목 키워드 기반

BBQ-to-Image: Numeric Bounding Box and Qolor Control in Large-Scale Text-to-Image Models

2026-02-24 · Eliran Kachlon, Alexander Visheratin, Nimrod Sarid, Tal Hacham 외 arxiv

Text-to-image models have rapidly advanced in realism and controllability, with recent approaches leveraging long, detailed captions to support fine-grained generation. However, a fundamental parametric gap remains: exis…

GenColorBench: A Color Evaluation Benchmark for Text-to-Image Generation Models

2025-10-23 · Muhammad Atif Butt, Alexandra Gomez-Villa, Tao Wu, Javier Vazquez-Corral 외 arxiv

Recent years have seen impressive advances in text-to-image generation, with image generative or unified models producing high-quality images from text. Yet these models still struggle with fine-grained color controllabi…

Text-to-Image Generation

Controllable-Continuous Color Editing in Diffusion Model via Color Mapping

2025-09-17 · Yuqi Yang, Dongliang Chang, Yuanchen Fang, Yi-Zhe SonG 외 arxiv

In recent years, text-driven image editing has made significant progress. However, due to the inherent ambiguity and discreteness of natural language, color editing still faces challenges such as insufficient precision a…

Continuous ControlImage Editing

Leveraging Semantic Attribute Binding for Free-Lunch Color Control in Diffusion Models

2025-03-12 · Héctor Laria, Alexandra Gomez-Villa, Jiang Qin, Muhammad Atif Butt 외

Recent advances in text-to-image (T2I) diffusion models have enabled remarkable control over various attributes, yet precise color specification remains a fundamental challenge. Existing approaches, such as ColorPeel, re…

AttributeDiversityImage Generation

MangaNinja: Line Art Colorization with Precise Reference Following

2025-01-14 · CVPR 2025 1 · Zhiheng Liu, Ka Leong Cheng, Xi Chen, Jie Xiao 외

Derived from diffusion models, MangaNinjia specializes in the task of reference-guided line art colorization. We incorporate two thoughtful designs to ensure precise character detail transcription, including a patch shuf…

ColorizationLine Art Colorization