paper-with-me

홈 › Papers

Regenerating Arbitrary Video Sequences with Distillation Path-Finding

2023-11-13 · Thi-Ngoc-Hanh Le, Sheng-Yi Yao, Chun-Te Wu, Tong-Yee Lee

If the video has long been mentioned as a widespread visualization form, the animation sequence in the video is mentioned as storytelling for people. Producing an animation requires intensive human labor from skilled professional artists to obtain plausible animation in both content and motion direction, incredibly for animations with complex content, multiple moving objects, and dense movement. This paper presents an interactive framework to generate new sequences according to the users' preference on the starting frame. The critical contrast of our approach versus prior work and existing commercial applications is that novel sequences with arbitrary starting frame are produced by our system with a consistent degree in both content and motion direction. To achieve this effectively, we first learn the feature correlation on the frameset of the given video through a proposed network called RSFNet. Then, we develop a novel path-finding algorithm, SDPF, which formulates the knowledge of motion directions of the source video to estimate the smooth and plausible sequences. The extensive experiments show that our framework can produce new animations on the cartoon and natural scenes and advance prior works and commercial applications to enable users to obtain more predictable results.

📄 PDF Abstract BibTeX arXiv:2311.07170

Code (1)

LeHanhcs/SDPF_VideoResequencing 공식 구현 tf

Tasks

Feature Correlation

Similar Papers 제목 키워드 기반

Dynamics Transfer GAN: Generating Video by Transferring Arbitrary Temporal Dynamics from a Source Video to a Single Target Image

2017-12-10 · Wissam J. Baddar, Geonmo Gu, Sangmin Lee, Yong Man Ro

In this paper, we propose Dynamics Transfer GAN; a new method for generating video sequences based on generative adversarial learning. The spatial constructs of a generated video sequence are acquired from the target ima…

A Large-scale Varying-view RGB-D Action Dataset for Arbitrary-view Human Action Recognition

2019-04-24 · Yanli Ji, Feixiang Xu, Yang Yang, Fumin Shen 외

Current researches of action recognition mainly focus on single-view and multi-view recognition, which can hardly satisfies the requirements of human-robot interaction (HRI) applications to recognize actions from arbitra…

Action AnalysisAction RecognitionSkeleton Based Action RecognitionTemporal Action Localization

Adaptive Identity Anchoring: Closed-Loop Keyframe Placement for Synthetic Paired Supervision in Video Face Swapping

2026-07-23 · Logan Robbins arxiv

Video face swapping has no natural paired supervision: no real footage exists of one person's face performing another person's video. The strongest current answer, DreamID-V's SyncID-Pipe, mints pairs by replacing the id…

Face Swapping

CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narratives

2026-05-12 · Yihao Meng, Zichen Liu, Hao Ouyang, Qiuyu Wang 외 arxiv

Autoregressive video generation aims at real-time, open-ended synthesis. Yet, cinematic storytelling is not merely the endless extension of a single scene; it requires progressing through evolving events, viewpoint shift…

Video Generation

Distilling Neural Fields for Real-Time Articulated Shape Reconstruction

2023-01-01 · CVPR 2023 1 · Jeff Tan, Gengshan Yang, Deva Ramanan

We present a method for reconstructing articulated 3D models from videos in real-time, without test-time optimization or manual 3D supervision at training time. Prior work often relies on pre-built deformable models …

motion prediction