An Impartial Transformer for Story Visualization
Story Visualization is an advanced task of computed vision that targets sequential image synthesis, where the generated samples need to be realistic, faithful to their conditioning and sequentially consistent. Our work proposes a novel architectural and training approach: the Impartial Transformer achieves both text-relevant plausible scenes and sequential consistency utilizing as few trainable parameters as possible. This enhancement is even able to handle synthesis of 'hard' samples with occluded objects, achieving improved evaluation metrics comparing to past approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationStory VisualizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Generating a Temporally Coherent Image Sequence for a Story by Multimodal Recurrent Transformers
Story visualization is a challenging text-to-image generation task for the difficulty of rendering visual details from abstract text descriptions. Besides the difficulty of image generation, the generator also need to c…
Image GenerationSentenceStory VisualizationText to Image Generation+1StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuation
Recent advances in text-to-image synthesis have led to large pretrained transformers with excellent capabilities to generate visualizations from a given text. However, these models are ill-suited for specialized tasks li…
Image GenerationStory ContinuationStory VisualizationVideo CaptioningCharacter-Centric Story Visualization via Visual Planning and Token Alignment
Story visualization advances the traditional text-to-image generation by enabling multiple image generation based on a complete story. This task requires machines to 1) understand long text inputs and 2) produce a global…
Image GenerationStory VisualizationText to Image GenerationText-to-Image GenerationGenerating a Temporally Coherent Visual Story by Multimodal Recurrent Transformers
Story visualization is a challenging text-to-image generation task for the difficulty of rendering visual details from abstract text descriptions. Besides the difficulty of image generation, the generator also needs to c…
Image GenerationSentenceStory VisualizationText to Image Generation+1Character-Preserving Coherent Story Visualization
Story visualization aims at generating a sequence of images to narrate each sentence in a multi-sentence story. Different from video generation that focuses on maintaining the continuity of generated images (frames), sto…
Representation LearningSentenceStory Visualization