Creative Flow+ Dataset
We present the Creative Flow+ Dataset, the first diverse multi-style artistic video dataset richly labeled with per-pixel optical flow, occlusions, correspondences, segmentation labels, normals, and depth. Our dataset includes 3000 animated sequences rendered using styles randomly selected from 40 textured line styles and 38 shading styles, spanning the range between flat cartoon fill and wildly sketchy shading. Our dataset includes 124K+ train set frames and 10K test set frames rendered at 1500x1500 resolution, far surpassing the largest available optical flow datasets in size. While modern techniques for tasks such as optical flow estimation achieve impressive performance on realistic images and video, today there is no way to gauge their performance on non-photorealistic images. Creative Flow+ poses a new challenge to generalize real-world Computer Vision to messy stylized content. We show that learning-based optical flow methods fail to generalize to this data and struggle to compete with classical approaches, and invite new research in this area. Our dataset and a new optical flow benchmark will be publicly available at: www.cs.toronto.edu/creativeflow/. We further release the complete dataset creation pipeline, allowing the community to generate and stylize their own data on demand.
Code (1)
Tasks
3D Character Animation From A Single PhotoDepth EstimationImage AnimationObject TrackingOptical Flow EstimationStyle GeneralizationSurface Normals EstimationVideo Style TransferVideo UnderstandingSimilar Papers 제목 키워드 기반
PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow
Graphic design is a creative and innovative process that plays a crucial role in applications such as e-commerce and advertising. However, developing an automated design system that can faithfully translate user intentio…
Orchid: Orchestrating Context Across Creative Workflows with Generative AI
Context is critical for meaningful interactions between people and Generative AI (GenAI). Yet mainstream tools offer limited means to orchestrate it, particularly across workflows that span multiple interactions, session…
Artificial Intelligence in Creative Industries: Advances Prior to 2025
The rapid advancements in artificial intelligence (AI), particularly in generative AI and large language models (LLMs), have profoundly impacted the creative industries by enabling innovative content creation, enhancing …
Data Compressionmultimodal generationNavigateCreative Procedural-Knowledge Extraction From Web Design Tutorials
Complex design tasks often require performing diverse actions in a specific order. To (semi-)autonomously accomplish these tasks, applications need to understand and learn a wide range of design procedures, i.e., Creativ…
Knowledge Base Constructiontext-classificationText ClassificationDesigning Participatory AI: Creative Professionals' Worries and Expectations about Generative AI
Generative AI, i.e., the group of technologies that automatically generate visual or written content based on text prompts, has undergone a leap in complexity and become widely available within just a few years. Such tec…