Dynamic Texture Synthesis by Incorporating Long-range Spatial and Temporal Correlations
The main challenge of dynamic texture synthesis lies in how to maintain spatial and temporal consistency in synthesized videos. The major drawback of existing dynamic texture synthesis models comes from poor treatment of the long-range texture correlation and motion information. To address this problem, we incorporate a new loss term, called the Shifted Gram loss, to capture the structural and long-range correlation of the reference texture video. Furthermore, we introduce a frame sampling strategy to exploit long-period motion across multiple frames. With these two new techniques, the application scope of existing texture synthesis models can be extended. That is, they can synthesize not only homogeneous but also structured dynamic texture patterns. Thorough experimental results are provided to demonstrate that our proposed dynamic texture synthesis model offers state-of-the-art visual performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Texture SynthesisSimilar Papers 제목 키워드 기반
Long Range Constraints for Neural Texture Synthesis Using Sliced Wasserstein Loss
In the past decade, exemplar-based texture synthesis algorithms have seen strong gains in performance by matching statistics of deep convolutional neural networks. However, these algorithms require regularization terms o…
TAGTexture SynthesisTowards Universal Texture Synthesis by Combining Texton Broadcasting with Noise Injection in StyleGAN-2
We present a new approach for universal texture synthesis by incorporating a multi-scale texton broadcasting module in the StyleGAN-2 framework. The texton broadcasting module introduces an inductive bias, enabling gener…
DiversityInductive BiasTexture SynthesisTexture Image Synthesis Using Spatial GAN Based on Vision Transformers
Texture synthesis is a fundamental task in computer vision, whose goal is to generate visually realistic and structurally coherent textures for a wide range of applications, from graphics to scientific simulations. While…
Generative Adversarial NetworkImage GenerationSSIMTexture SynthesisHigh resolution neural texture synthesis with long range constraints
The field of texture synthesis has witnessed important progresses over the last years, most notably through the use of Convolutional Neural Networks. However, neural synthesis methods still struggle to reproduce large sc…
Texture SynthesisVocal Bursts Intensity PredictionIncorporating long-range consistency in CNN-based texture generation
Gatys et al. (2015) showed that pair-wise products of features in a convolutional network are a very effective representation of image textures. We propose a simple modification to that representation which makes it poss…
Image GenerationTexture Synthesis