Papers Story Visualization
“Story Visualization” 태그가 달린 논문 50편 · 필터 해제
Masked Generative Story Transformer with Character Guidance and Caption Augmentation
Story Visualization (SV) is a challenging generative vision task, that requires both visual quality and consistency between different frames in generated image sequences. Previous approaches either employ some kind of me…
Language ModelingLanguage ModellingLarge Language ModelStory VisualizationTraining-Free Consistent Text-to-Image Generation
Text-to-image models offer a new level of creative flexibility by allowing users to guide the image generation process through natural language. However, using these models to consistently portray the same subject across…
DiversityImage GenerationStory VisualizationText to Image Generation+1CogCartoon: Towards Practical Story Visualization
The state-of-the-art methods for story visualization demonstrate a significant demand for training data and storage, as well as limited flexibility in story presentation, thereby rendering them impractical for real-world…
Story VisualizationMake-A-Storyboard: A General Framework for Storyboard with Disentangled and Merged Control
Story Visualization aims to generate images aligned with story prompts, reflecting the coherence of storybooks through visual consistency among characters and scenes.Whereas current approaches exclusively concentrate on …
Story VisualizationStoryGPT-V: Large Language Models as Consistent Story Visualizers
Recent generative models have demonstrated impressive capabilities in generating realistic and visually pleasing images grounded on textual prompts. Nevertheless, a significant challenge remains in applying these models …
Language ModellingLarge Language ModelNavigateStory VisualizationAutoStory: Generating Diverse Storytelling Images with Minimal Human Effort
Story visualization aims to generate a series of images that match the story described in texts, and it requires the generated images to satisfy high quality, alignment with the text description, and consistency in chara…
Image GenerationStory VisualizationThe Chosen One: Consistent Characters in Text-to-Image Diffusion Models
Recent advances in text-to-image generation models have unlocked vast potential for visual creativity. However, the users that use these models struggle with the generation of consistent characters, a crucial aspect for …
Consistent Character GenerationImage GenerationStory VisualizationText to Image Generation+1Style Generation: Image Synthesis based on Coarsely Matched Texts
Previous text-to-image synthesis algorithms typically use explicit textual instructions to generate/manipulate images accurately, but they have difficulty adapting to guidance in the form of coarsely matched texts. In th…
Generative Adversarial NetworkImage GenerationSentenceStory VisualizationStoryBench: A Multifaceted Benchmark for Continuous Story Visualization
Generating video stories from text prompts is a complex task. In addition to having high visual quality, videos need to realistically adhere to a sequence of text prompts whilst being consistent throughout the frames. Cr…
Story ContinuationStory GenerationStory VisualizationVideo GenerationStory Visualization by Online Text Augmentation with Context Memory
Story visualization (SV) is a challenging text-to-image generation task for the difficulty of not only rendering visual details from the text descriptions but also encoding a long-term context across multiple sentences. …
Image GenerationSentenceStory VisualizationText Augmentation+2Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Models
Generative models have recently exhibited exceptional capabilities in text-to-image generation, but still struggle to generate image sequences coherently. In this work, we focus on a novel, yet challenging task of genera…
Image GenerationStory VisualizationStyle TransferText to Image Generation+2TaleCrafter: Interactive Story Visualization with Multiple Characters
Accurate Story visualization requires several necessary elements, such as identity consistency across frames, the alignment between plain text and visual content, and a reasonable layout of objects in images. Most previo…
Image GenerationLayout GenerationStory VisualizationText to Image Generation+1Improved Visual Story Generation with Adaptive Context Modeling
Diffusion models developed on top of powerful text-to-image generation models like Stable Diffusion achieve remarkable success in visual story generation. However, the best-performing approach considers historically gene…
Image GenerationStory GenerationStory VisualizationText to Image Generation+1Counterfactual Edits for Generative Evaluation
Evaluation of generative models has been an underrepresented field despite the surge of generative architectures. Most recent models are evaluated upon rather obsolete metrics which suffer from robustness issues, while b…
counterfactualStory VisualizationAn Impartial Transformer for Story Visualization
Story Visualization is an advanced task of computed vision that targets sequential image synthesis, where the generated samples need to be realistic, faithful to their conditioning and sequentially consistent. Our work p…
Image GenerationStory VisualizationMake-A-Story: Visual Memory Conditioned Consistent Story Generation
There has been a recent explosion of impressive generative models that can produce high quality images (or videos) conditioned on text descriptions. However, all such approaches rely on conditional sentences that contain…
SentenceStory GenerationStory VisualizationSynthesizing Coherent Story with Auto-Regressive Latent Diffusion Models
Conditioned diffusion models have demonstrated state-of-the-art text-to-image synthesis capacity. Recently, most works focus on synthesizing independent images; While for real-world applications, it is common and necessa…
Story ContinuationStory VisualizationLearning to Model Multimodal Semantic Alignment for Story Visualization
Story visualization aims to generate a sequence of images to narrate each sentence in a multi-sentence story, where the images should be realistic and keep global consistency across dynamic scenes and characters. Current…
DiversitySentenceStory VisualizationCharacter-Centric Story Visualization via Visual Planning and Token Alignment
Story visualization advances the traditional text-to-image generation by enabling multiple image generation based on a complete story. This task requires machines to 1) understand long text inputs and 2) produce a global…
Image GenerationStory VisualizationText to Image GenerationText-to-Image GenerationStoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuation
Recent advances in text-to-image synthesis have led to large pretrained transformers with excellent capabilities to generate visualizations from a given text. However, these models are ill-suited for specialized tasks li…
Image GenerationStory ContinuationStory VisualizationVideo Captioning