paper-with-me

홈 › Papers

Interactive Video Stylization Using Few-Shot Patch-Based Training

2020-04-29 · Ondřej Texler, David Futschik, Michal Kučera, Ondřej Jamriška, Šárka Sochorová, Menglei Chai, Sergey Tulyakov, Daniel Sýkora

In this paper, we present a learning-based method to the keyframe-based video stylization that allows an artist to propagate the style from a few selected keyframes to the rest of the sequence. Its key advantage is that the resulting stylization is semantically meaningful, i.e., specific parts of moving objects are stylized according to the artist's intention. In contrast to previous style transfer techniques, our approach does not require any lengthy pre-training process nor a large training dataset. We demonstrate how to train an appearance translation network from scratch using only a few stylized exemplars while implicitly preserving temporal consistency. This leads to a video stylization framework that supports real-time inference, parallel processing, and random access to an arbitrary output frame. It can also merge the content from multiple keyframes without the need to perform an explicit blending operation. We demonstrate its practical utility in various interactive scenarios, where the user paints over a selected keyframe and sees her style transferred to an existing recorded sequence or a live video stream.

📄 PDF Abstract BibTeX arXiv:2004.14489

Code (2)

OndrejTexler/Few-Shot-Patch-Based-Training 공식 구현 pytorch
rnwzd/FSPBT-Image-Translation pytorch

Tasks

Style TransferTranslationVideo Propagation

Similar Papers 제목 키워드 기반

Interactive Control over Temporal Consistency while Stylizing Video Streams

2023-01-02 · Sumit Shekhar, Max Reimann, Moritz Hilscher, Amir Semmo 외

Image stylization has seen significant advancement and widespread interest over the years, leading to the development of a multitude of techniques. Extending these stylization techniques, such as Neural Style Transfer (N…

Image StylizationOptical Flow EstimationStyle TransferVideo Stabilization+1

DiT as Real-Time Rerenderer: Streaming Video Stylization with Autoregressive Diffusion Transformer

2026-04-15 · Hengye Lyu, Zisu Li, Yue Hong, Yueting Weng 외 arxiv

Recent advances in video generation models has significantly accelerated video generation and related downstream tasks. Among these, video stylization holds important research value in areas such as immersive application…

Video Generation

V-Stylist: Video Stylization via Collaboration and Reflection of MLLM Agents

2025-01-01 · CVPR 2025 1 · Zhengrong Yue, Shaobin Zhuang, Kunchang Li, Yanbo Ding 외

Despite the recent advancement in video stylization, most existing methods struggle to render any video with complex transitions,based on an open style description of user query.To fill this gap,we introduce a generi…

DiffSynth: Latent In-Iteration Deflickering for Realistic Video Synthesis

2023-08-07 · Zhongjie Duan, Lizhou You, Chengyu Wang, Cen Chen 외

In recent years, diffusion models have emerged as the most powerful approach in image synthesis. However, applying these models directly to video synthesis presents challenges, as it often leads to noticeable flickering …

Image Generation

Controlling strokes in fast neural style transfer using content transforms

2022-06-08 · The Visual Computer 2022 6 · Max Reimann, Benito Buchheim, Amir Semmo, Jürgen Döllner 외

Fast style transfer methods have recently gained popularity in art-related applications as they make a generalized real-time stylization of images practicable. However, they are mostly limited to one-shot stylizations co…

Style Transfer