Fine-grained Semantic Constraint in Image Synthesis
In this paper, we propose a multi-stage and high-resolution model for image synthesis that uses fine-grained attributes and masks as input. With a fine-grained attribute, the proposed model can detailedly constrain the features of the generated image through rich and fine-grained semantic information in the attribute. With mask as prior, the model in this paper is constrained so that the generated images conform to visual senses, which will reduce the unexpected diversity of samples generated from the generative adversarial network. This paper also proposes a scheme to improve the discriminator of the generative adversarial network by simultaneously discriminating the total image and sub-regions of the image. In addition, we propose a method for optimizing the labeled attribute in datasets, which reduces the manual labeling noise. Extensive quantitative results show that our image synthesis model generates more realistic images.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeDiversityGenerative Adversarial NetworkImage GenerationSimilar Papers 제목 키워드 기반
Fine-grained Cross-modal Fusion based Refinement for Text-to-Image Synthesis
Text-to-image synthesis refers to generating visual-realistic and semantically consistent images from given textual descriptions. Previous approaches generate an initial low-resolution image and then refine it to be high…
Image GenerationVisually-Guided Controllable Medical Image Generation via Fine-Grained Semantic Disentanglement
Medical image synthesis is crucial for alleviating data scarcity and privacy constraints. However, fine-tuning general text-to-image (T2I) models remains challenging, mainly due to the significant modality gap between co…
Medical Image GenerationRetrieval-based Spatially Adaptive Normalization for Semantic Image Synthesis
Semantic image synthesis is a challenging task with many practical applications. Albeit remarkable progress has been made in semantic image synthesis with spatially-adaptive normalization and existing methods normalize t…
Image GenerationRetrievalMedical Image Synthesis via Fine-Grained Image-Text Alignment and Anatomy-Pathology Prompting
Data scarcity and privacy concerns limit the availability of high-quality medical images for public use, which can be mitigated through medical image synthesis. However, current medical image synthesis methods often stru…
AnatomyDescriptiveImage GenerationReconciling Semantic Controllability and Diversity for Remote Sensing Image Synthesis with Hybrid Semantic Embedding
Significant advancements have been made in semantic image synthesis in remote sensing. However, existing methods still face formidable challenges in balancing semantic controllability and diversity. In this paper, we pre…
Data AugmentationDiversityGenerative Adversarial NetworkImage Generation