Coherent Online Video Style Transfer
Training a feed-forward network for fast neural style transfer of images is proven to be successful. However, the naive extension to process video frame by frame is prone to producing flickering results. We propose the first end-to-end network for online video style transfer, which generates temporally coherent stylized video sequences in near real-time. Two key ideas include an efficient network by incorporating short-term coherence, and propagating short-term coherence to long-term, which ensures the consistency over larger period of time. Our network can incorporate different image stylization networks. We show that the proposed method clearly outperforms the per-frame baseline both qualitatively and quantitatively. Moreover, it can achieve visually comparable coherence to optimization-based video style transfer, but is three orders of magnitudes faster in runtime.
Code (0)
등록된 구현이 없습니다.
Tasks
Image StylizationStyle TransferVideo Style TransferSimilar Papers 제목 키워드 기반
ReCoNet: Real-time Coherent Video Style Transfer Network
Image style transfer models based on convolutional neural networks usually suffer from high temporal inconsistency when applied to videos. Some video style transfer models have been proposed to improve temporal consisten…
Semantic SegmentationStyle TransferVideo Style TransferPickStyle: Video-to-Video Style Transfer with Context-Style Adapters
We address the task of video style transfer with diffusion models, where the goal is to preserve the context of an input video while rendering it in a target style specified by a text prompt. A major challenge is the lac…
Style TransferStyle-ERD: Responsive and Coherent Online Motion Style Transfer
Motion style transfer is a common method for enriching character animation. Motion style transfer algorithms are often designed for offline settings where motions are processed in segments. However, for online animation …
DecoderMotion Style TransferStyle TransferReal-time Localized Photorealistic Video Style Transfer
We present a novel algorithm for transferring artistic styles of semantically meaningful local regions of an image onto local regions of a target video while preserving its photorealism. Local regions may be selected eit…
Style TransferVideo SegmentationVideo Semantic SegmentationVideo Style TransferHairShifter: Consistent and High-Fidelity Video Hair Transfer via Anchor-Guided Animation
Hair transfer is increasingly valuable across domains such as social media, gaming, advertising, and entertainment. While significant progress has been made in single-image hair transfer, video-based hair transfer remain…