Composing a Picture Book by Automatic Story Understanding and Visualization
Pictures can enrich storytelling experiences. We propose a framework that can automatically compose a picture book by understanding story text and visualizing it with painting elements, i.e., characters and backgrounds. For story understanding, we extract key information from a story on both sentence level and paragraph level, including characters, scenes and actions. These concepts are organized and visualized in a way that depicts the development of a story. We collect a set of Chinese stories for children and apply our approach to compose pictures for stories. Extensive experiments are conducted towards story event extraction for visualization to demonstrate the effectiveness of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
Event ExtractionSentenceSimilar Papers 제목 키워드 기반
What your Facebook Profile Picture Reveals about your Personality
People spend considerable effort managing the impressions they give others. Social psychologists have shown that people manage these impressions differently depending upon their personality. Facebook and other social med…
General ClassificationEducational Question Generation of Children Storybooks via Question Type Distribution Learning and Event-Centric Summarization
Generating educational questions of fairytales or storybooks is vital for improving children's literacy ability. However, it is challenging to generate questions that capture the interesting aspects of a fairytale story …
Question AnsweringQuestion GenerationQuestion-GenerationIllustrative Language Understanding: Large-Scale Visual Grounding with Image Search
We introduce Picturebook, a large-scale lookup operation to ground language via {`}snapshots{'} of our physical world accessed through image search. For each word in a vocabulary, we extract the top-$k$ images from Googl…
General ClassificationImage RetrievalMachine TranslationNatural Language Inference+6It is AI’s Turn to Ask Human a Question: Question and Answer Pair Generation for Children Storybooks in FairytaleQA Dataset
Existing question answering (QA) techniques are created mainly to answer questions asked by humans. But in educational applications, teachers and parents sometimes may not know what questions they should ask best help ch…
Answer GenerationQuestion-Answer-GenerationQuestion AnsweringIt is AI's Turn to Ask Humans a Question: Question-Answer Pair Generation for Children's Story Books
Existing question answering (QA) techniques are created mainly to answer questions asked by humans. But in educational applications, teachers often need to decide what questions they should ask, in order to help students…
Answer GenerationData AugmentationLanguage ModellingQuestion-Answer-Generation+1