Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications
The generative adversarial network (GAN) framework has emerged as a powerful tool for various image and video synthesis tasks, allowing the synthesis of visual content in an unconditional or input-conditional manner. It has enabled the generation of high-resolution photorealistic images and videos, a task that was challenging or impossible with prior methods. It has also led to the creation of many new applications in content creation. In this paper, we provide an overview of GANs with a special focus on algorithms and applications for visual synthesis. We cover several important techniques to stabilize GAN training, which has a reputation for being notoriously difficult. We also discuss its applications to image translation, image processing, video synthesis, and neural rendering.
Code (0)
등록된 구현이 없습니다.
Tasks
Generative Adversarial NetworkNeural RenderingTranslationSimilar Papers 제목 키워드 기반
End-to-End Time-Lapse Video Synthesis from a Single Outdoor Image
Time-lapse videos usually contain visually appealing content but are often difficult and costly to create. In this paper, we present an end-to-end solution to synthesize a time-lapse video from a single outdoor image usi…
Generative Adversarial NetworkAdversarial Video Generation on Complex Datasets
Generative models of natural images have progressed towards high fidelity samples by the strong leveraging of scale. We attempt to carry this success to the field of video modeling by showing that large Generative Advers…
3D Character Animation From A Single PhotoVideo GenerationVideo PredictionVideo-to-Video Synthesis
We study the problem of video-to-video synthesis, whose goal is to learn a mapping function from an input source video (e.g., a sequence of semantic segmentation masks) to an output photorealistic video that precisely de…
2kSemantic SegmentationVideo derainingVideo Prediction+1Video to Video Generative Adversarial Network for Few-shot Learning Based on Policy Gradient
The development of sophisticated models for video-to-video synthesis has been facilitated by recent advances in deep reinforcement learning and generative adversarial networks (GANs). In this paper, we propose RL-V2V-GAN…
Deep Reinforcement LearningFew-Shot LearningGenerative Adversarial Networkreinforcement-learning+2Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks
This paper proposes Markovian Generative Adversarial Networks (MGANs), a method for training generative neural networks for efficient texture synthesis. While deep neural network approaches have recently demonstrated rem…
Style TransferTexture Synthesis