paper-with-me

홈 › Papers

High Fidelity Text to Image Generation with Contrastive Alignment and Structural Guidance

2025-08-14 · Danyi Gao arxiv

This paper addresses the performance bottlenecks of existing text-driven image generation methods in terms of semantic alignment accuracy and structural consistency. A high-fidelity image generation method is proposed by integrating text-image contrastive constraints with structural guidance mechanisms. The approach introduces a contrastive learning module that builds strong cross-modal alignment constraints to improve semantic matching between text and image. At the same time, structural priors such as semantic layout maps or edge sketches are used to guide the generator in spatial-level structural modeling. This enhances the layout completeness and detail fidelity of the generated images. Within the overall framework, the model jointly optimizes contrastive loss, structural consistency loss, and semantic preservation loss. A multi-objective supervision mechanism is adopted to improve the semantic consistency and controllability of the generated content. Systematic experiments are conducted on the COCO-2014 dataset. Sensitivity analyses are performed on embedding dimensions, text length, and structural guidance strength. Quantitative metrics confirm the superior performance of the proposed method in terms of CLIP Score, FID, and SSIM. The results show that the method effectively bridges the gap between semantic alignment and structural fidelity without increasing computational complexity. It demonstrates a strong ability to generate semantically clear and structurally complete images, offering a viable technical path for joint text-image modeling and image generation.

📄 PDF Abstract BibTeX arXiv:2508.10280

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningImage Generation

Similar Papers 제목 키워드 기반

SHYI: Action Support for Contrastive Learning in High-Fidelity Text-to-Image Generation

2025-01-15 · Tianxiang Xia, Lin Xiao, Yannick Montorfani, Francesco Pavia 외

In this project, we address the issue of infidelity in text-to-image generation, particularly for actions involving multiple objects. For this we build on top of the CONFORM framework which uses Contrastive Learning to i…

Contrastive LearningImage Generationtext similarityText to Image Generation+1

ContrastiveGaussian: High-Fidelity 3D Generation with Contrastive Learning and Gaussian Splatting

2025-04-10 · Junbang Liu, Enpei Huang, Dongxing Mao, HUI ZHANG 외

Creating 3D content from single-view images is a challenging problem that has attracted considerable attention in recent years. Current approaches typically utilize score distillation sampling (SDS) from pre-trained 2D d…

3D GenerationContrastive LearningSuper-ResolutionTriplet

PuLID: Pure and Lightning ID Customization via Contrastive Alignment

2024-04-24 · Zinan Guo, Yanze Wu, Zhuowei Chen, Lang Chen 외

We propose Pure and Lightning ID customization (PuLID), a novel tuning-free ID customization method for text-to-image generation. By incorporating a Lightning T2I branch with a standard diffusion one, PuLID introduces bo…

Image GenerationText to Image GenerationText-to-Image Generation

Comparison Reveals Commonality: Customized Image Generation through Contrastive Inversion

2025-08-11 · Minseo Kim, Minchan Kwon, Dongyeun Lee, Yunho Jeon 외 arxiv

The recent demand for customized image generation raises a need for techniques that effectively extract the common concept from small sets of images. Existing methods typically rely on additional guidance, such as text p…

Contrastive LearningImage Generation

Diverse Text-to-Image Generation via Contrastive Noise Optimization

2025-10-04 · Byungjun Kim, Soobin Um, Jong Chul Ye arxiv

Text-to-image (T2I) diffusion models have demonstrated impressive performance in generating high-fidelity images, largely enabled by text-guided inference. However, this advantage often comes with a critical drawback: li…

Text-to-Image Generation