paper-with-me

홈 › Papers

Semantic Browsing: Controllable Diversity for Image Generation

2026-06-22 · Sara Dorfman, Maya Vishnevsky, Omer Dahary, Or Patashnik, Daniel Cohen-Or arxiv

Modern text-to-image models excel in visual fidelity and prompt adherence. However, this strict adherence comes at the cost of diversity: generated samples tend to collapse into a single visual interpretation. Existing methods to improve diversity produce outputs driven by incidental variations rather than meaningful design choices. This motivates a new variant of the diversity task where structure is enforced on the generated samples. We introduce a method for controlled diversity that enables Semantic Browsing, where users can navigate structured image galleries and experience creative exploration through a systematic traversal of meaningful, interpretable axes of variation. Achieving this level of semantic control requires a deep understanding of the scene. We exploit the fact that recent text-to-image models are trained on elaborated captions, effectively decoupling semantic decision-making from pixel generation. This enables a paradigm shift: instead of relying on stochastic variation within the text-to-image model, we induce diversity directly at the text level. By leveraging rich textual representations, we allow a Vision Language Model (VLM) to operate on the full scene context. To overcome the generic outputs typical of standard VLMs, we employ an agentic workflow that explicitly enforces structured variation attuned to the original prompt. We demonstrate that our method produces diverse and navigable design spaces where every variation corresponds to a specific, user-understandable semantic decision.

📄 PDF Abstract BibTeX arXiv:2606.23679

Code (0)

등록된 구현이 없습니다.

Tasks

Image Generation

Similar Papers 제목 키워드 기반

Diffusion Autoencoders for Few-shot Image Generation in Hyperbolic Space

2024-11-27 · Lingxiao Li, Kaixuan Fan, Boqing Gong, Xiangyu Yue

Few-shot image generation aims to generate diverse and high-quality images for an unseen class given only a few examples in that class. However, existing methods often suffer from a trade-off between image quality and di…

DiversityImage Generation

Variational Conditional GAN for Fine-grained Controllable Image Generation

2019-09-22 · Mingqi Hu, Deyu Zhou, Yulan He

In this paper, we propose a novel variational generator framework for conditional GANs to catch semantic details for improving the generation quality and diversity. Traditional generators in conditional GANs simply conca…

DiversityImage GenerationVariational Inference

SesaHand: Enhancing 3D Hand Reconstruction via Controllable Generation with Semantic and Structural Alignment

2026-02-28 · Zhuoran Zhao, Xianghao Kong, Linlin Yang, Zheng Wei 외 arxiv

Recent studies on 3D hand reconstruction have demonstrated the effectiveness of synthetic training data to improve estimation performance. However, most methods rely on game engines to synthesize hand images, which often…

Image Generation

Improved Paraphrase Generation via Controllable Latent Diffusion

2024-04-13 · Wei Zou, Ziyuan Zhuang, Xiang Geng, ShuJian Huang 외

Paraphrase generation strives to generate high-quality and diverse expressions of a given text, a domain where diffusion models excel. Though SOTA diffusion generation reconciles generation quality and diversity, textual…

DiversityParaphrase Generation

The Euclidean Space is Evil: Hyperbolic Attribute Editing for Few-shot Image Generation

2022-11-22 · ICCV 2023 1 · Lingxiao Li, Yi Zhang, Shuhui Wang

Few-shot image generation is a challenging task since it aims to generate diverse new images for an unseen category with only a few images. Existing methods suffer from the trade-off between the quality and diversity of …

AttributeDiversityImage Generation