paper-with-me

Papers

Style Generator Inversion for Image Enhancement and Animation

2019-06-05 · Aviv Gabbay, Yedid Hoshen

One of the main motivations for training high quality image generative models is their potential use as tools for image manipulation. Recently, generative adversarial networks (GANs) have been able to generate images of remarkable quality. Unfortunately, adversarially-trained unconditional generator networks have not been successful as image priors. One of the main requirements for a network to act as a generative image prior, is being able to generate every possible image from the target distribution. Adversarial learning often experiences mode-collapse, which manifests in generators that cannot generate some modes of the target distribution. Another requirement often not satisfied is invertibility i.e. having an efficient way of finding a valid input latent code given a required output image. In this work, we show that differently from earlier GANs, the very recently proposed style-generators are quite easy to invert. We use this important observation to propose style generators as general purpose image priors. We show that style generators outperform other GANs as well as Deep Image Prior as priors for image enhancement tasks. The latent space spanned by style-generators satisfies linear identity-pose relations. The latent space linearity, combined with invertibility, allows us to animate still facial images without supervision. Extensive experiments are performed to support the main contributions of this paper.

📄 PDF Abstract BibTeX arXiv:1906.11880

Code (1)

avivga/style-image-prior 공식 구현 tf

Tasks

Image EnhancementImage Manipulationvalid

Similar Papers 제목 키워드 기반

StyleCineGAN: Landscape Cinemagraph Generation using a Pre-trained StyleGAN

2024-03-21 · CVPR 2024 1 · Jongwoo Choi, Kwanggyoon Seo, Amirsaman Ashtari, Junyong Noh

We propose a method that can generate cinemagraphs automatically from a still landscape image using a pre-trained StyleGAN. Inspired by the success of recent unconditional video generation, we leverage a powerful pre-tra…

Unconditional Video GenerationVideo Generation

Style Transfer for 2D Talking Head Animation

2023-03-17 · Trong-Thang Pham, Nhat Le, Tuong Do, Hung Nguyen 외

Audio-driven talking head animation is a challenging research topic with many real-world applications. Recent works have focused on creating photo-realistic 2D animation, while learning different talking or singing style…

Style Transfer

AE-StyleGAN: Improved Training of Style-Based Auto-Encoders

2021-10-17 · Ligong Han, Sri Harsha Musunuri, Martin Renqiang Min, Ruijiang Gao 외

StyleGANs have shown impressive results on data generation and manipulation in recent years, thanks to its disentangled style latent space. A lot of efforts have been made in inverting a pretrained generator, where an en…

StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generation

2023-08-31 · ICCV 2023 1 · YuHan Wang, Liming Jiang, Chen Change Loy

Unconditional video generation is a challenging task that involves synthesizing high-quality videos that are both coherent and of extended duration. To address this challenge, researchers have used pretrained StyleGAN im…

Style TransferUnconditional Video GenerationVideo Generation

One Style is All you Need to Generate a Video

2023-10-27 · Sandeep Manandhar, Auguste Genovesio

In this paper, we propose a style-based conditional video generative model. We introduce a novel temporal generator based on a set of learned sinusoidal bases. Our method learns dynamic representations of various actions…

All