Synthesizing Dynamic Patterns by Spatial-Temporal Generative ConvNet
Video sequences contain rich dynamic patterns, such as dynamic texture patterns that exhibit stationarity in the temporal domain, and action patterns that are non-stationary in either spatial or temporal domain. We show that a spatial-temporal generative ConvNet can be used to model and synthesize dynamic patterns. The model defines a probability distribution on the video sequence, and the log probability is defined by a spatial-temporal ConvNet that consists of multiple layers of spatial-temporal filters to capture spatial-temporal patterns of different scales. The model can be learned from the training video sequences by an "analysis by synthesis" learning algorithm that iterates the following two steps. Step 1 synthesizes video sequences from the currently learned model. Step 2 then updates the model parameters based on the difference between the synthesized video sequences and the observed training sequences. We show that the learning algorithm can synthesize realistic dynamic patterns.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Learning Energy-based Spatial-Temporal Generative ConvNets for Dynamic Patterns
Video sequences contain rich dynamic patterns, such as dynamic texture patterns that exhibit stationarity in the temporal domain, and action patterns that are non-stationary in either spatial or temporal domain. We show …
Self-Supervised Spatial-Temporal Normality Learning for Time Series Anomaly Detection
Time Series Anomaly Detection (TSAD) finds widespread applications across various domains such as financial markets, industrial production, and healthcare. Its primary objective is to learn the normal patterns of time se…
Anomaly DetectionTime SeriesTime Series Anomaly DetectionA Generative Restricted Boltzmann Machine Based Method for High-Dimensional Motion Data Modeling
Many computer vision applications involve modeling complex spatio-temporal patterns in high-dimensional motion data. Recently, restricted Boltzmann machines (RBMs) have been widely used to capture and represent spatial p…
Action RecognitionFacial Expression RecognitionFacial Expression Recognition (FER)General Classification+2Wind Power Scenario Generation based on the Generalized Dynamic Factor Model and Generative Adversarial Network
For conducting resource adequacy studies, we synthesize multiple long-term wind power scenarios of distributed wind farms simultaneously by using the spatio-temporal features: spatial and temporal correlation, waveforms,…
Vid-CamEdit: Video Camera Trajectory Editing with Generative Rendering from Estimated Geometry
We introduce Vid-CamEdit, a novel framework for video camera trajectory editing, enabling the re-synthesis of monocular videos along user-defined camera paths. This task is challenging due to its ill-posed nature and the…
Novel View Synthesis