paper-with-me

Papers

Improving Video Generation for Multi-functional Applications

2017-11-30 · Bernhard Kratzwald, Zhiwu Huang, Danda Pani Paudel, Acharya Dinesh, Luc van Gool

In this paper, we aim to improve the state-of-the-art video generative adversarial networks (GANs) with a view towards multi-functional applications. Our improved video GAN model does not separate foreground from background nor dynamic from static patterns, but learns to generate the entire video clip conjointly. Our model can thus be trained to generate - and learn from - a broad set of videos with no restriction. This is achieved by designing a robust one-stream video generation architecture with an extension of the state-of-the-art Wasserstein GAN framework that allows for better convergence. The experimental results show that our improved video GAN model outperforms state-of-theart video generative models on multiple challenging datasets. Furthermore, we demonstrate the superiority of our model by successfully extending it to three challenging problems: video colorization, video inpainting, and future prediction. To the best of our knowledge, this is the first work using GANs to colorize and inpaint video clips.

📄 PDF Abstract BibTeX arXiv:1711.11453

Code (1)

bernhard2202/improved-video-gan 공식 구현 tf

Tasks

ColorizationFuture predictionVideo GenerationVideo Inpainting

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

OmniVDiff: Omni Controllable Video Diffusion for Generation and Understanding

2025-04-15 · Dianbing Xi, Jiepeng Wang, Yuanzhi Liang, Xi Qiu 외

In this paper, we propose a novel framework for controllable video diffusion, OmniVDiff, aiming to synthesize and comprehend multiple video visual content in a single diffusion model. To achieve this, OmniVDiff treats al…

Semantic SegmentationVideo GenerationVideo Understanding

Kandinsky 3: Text-to-Image Synthesis for Multifunctional Generative Framework

2024-10-28 · Vladimir Arkhipkin, Viacheslav Vasilev, Andrei Filatov, Igor Pavlov 외

Text-to-image (T2I) diffusion models are popular for introducing image manipulation methods, such as editing, image fusion, inpainting, etc. At the same time, image-to-video (I2V) and text-to-video (T2V) models are also …

Image GenerationImage Manipulation

Continuous-Time Video Generation via Learning Motion Dynamics with Neural ODE

2021-12-21 · Kangyeol Kim, Sunghyun Park, Junsoo Lee, Joonseok Lee 외

In order to perform unconditional video generation, we must learn the distribution of the real-world videos. In an effort to synthesize high-quality videos, various studies attempted to learn a mapping function between n…

Unconditional Video GenerationVideo Generation

OpenVVC: a Lightweight Software Decoder for the Versatile Video Coding Standard

2022-05-24 · Thomas Amestoy, Pierre-loup Cabarat, Guillaume Gautier, Wassim Hamidouche 외

In the recent years, users requirements for higher resolution, coupled with the apparition of new multimedia applications, have created the need for a new video coding standard. The new generation video coding standard, …

Decoder

Video2Code: Generating Interactive Webpages from UI Videos via Action-Aware Revisit

2026-06-16 · Mingde Xu, Zhen Yang, Yan Wang, Yu Wang 외 arxiv

UI videos provide a natural input for generating interactive webpages, as they capture both webpage appearance and action-triggered state transitions. However, directly applying video-capable vision-language models to th…

Code Generation