Multi-Attributed and Structured Text-to-Face Synthesis
Generative Adversarial Networks (GANs) have revolutionized image synthesis through many applications like face generation, photograph editing, and image super-resolution. Image synthesis using GANs has predominantly been uni-modal, with few approaches that can synthesize images from text or other data modes. Text-to-image synthesis, especially text-to-face synthesis, has promising use cases of robust face-generation from eye witness accounts and augmentation of the reading experience with visual cues. However, only a couple of datasets provide consolidated face data and textual descriptions for text-to-face synthesis. Moreover, these textual annotations are less extensive and descriptive, which reduces the diversity of faces generated from it. This paper empirically proves that increasing the number of facial attributes in each textual description helps GANs generate more diverse and real-looking faces. To prove this, we propose a new methodology that focuses on using structured textual descriptions. We also consolidate a Multi-Attributed and Structured Text-to-face (MAST) dataset consisting of high-quality images with structured textual annotations and make it available to researchers to experiment and build upon. Lastly, we report benchmark Frechet's Inception Distance (FID), Facial Semantic Similarity (FSS), and Facial Semantic Distance (FSD) scores for the MAST dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
DescriptiveDiversityFace GenerationImage GenerationImage Super-ResolutionSemantic SimilaritySemantic Textual SimilaritySuper-ResolutionSimilar Papers 제목 키워드 기반
Can LLMs Convert Graphs to Text-Attributed Graphs?
Graphs are ubiquitous data structures found in numerous real-world applications, such as drug discovery, recommender systems, and social network analysis. Graph neural networks (GNNs) have become a popular tool to learn …
Drug DiscoveryRecommendation SystemsTowards Direct Latent-Space Synthesis for Parallel Branches in LLM-Agent Workflows
Large language models increasingly serve as execution engines for agentic systems, yet they still consume context through a sequential text interface. This creates a mismatch with modern structured agent workflows, in wh…
Code GenerationBorderless Long Speech Synthesis
Most existing text-to-speech (TTS) systems either synthesize speech sentence by sentence and stitch the results together, or drive synthesis from plain-text dialogues alone. Both approaches leave models with little under…
Instruction FollowingSpeech SynthesisConTReGen: Context-driven Tree-structured Retrieval for Open-domain Long-form Text Generation
Open-domain long-form text generation requires generating coherent, comprehensive responses that address complex queries with both breadth and depth. This task is challenging due to the need to accurately capture diverse…
FormRAGRetrievalRetrieval-augmented Generation+1MARQUIS: A Three-Stage Pipeline for Video Retrieval-Augmented Generation
Retrieval-augmented generation from videos requires systems to retrieve relevant audiovisual evidence from large corpora and synthesize it into coherent, attributed text. Current approaches struggle at both ends: retriev…
Video Retrieval