paper-with-me

홈 › Papers

Generating Diverse High-Resolution Images with VQ-VAE

2019-03-27 · ICLR Workshop DeepGenStruct 2019 · Ali Razavi, Aaron van den Oord, Oriol Vinyals

We explore the use of Vector Quantized Variational AutoEncoder (VQ-VAE) models for large scale image generation. To this end, we scale and enhance the autoregressive priors used in VQ-VAE to generate synthetic samples of much higher coherence and fidelity than possible before. We use simple feed-forward encoder and decoder networks, thus our model is an attractive candidate for applications where the encoding and decoding speed is critical. Additionally, this allows us to only sample autoregressively in the compressed latent space, which is an order of magnitude faster than sampling in the pixel space, especially for large images. We demonstrate that a multi-scale hierarchical organization of VQ-VAE, augmented with powerful priors over the latent codes, is able to generate samples with quality that rivals that of state of the art Generative Adversarial Networks on multifaceted datasets such as ImageNet, while not suffering from GAN's known shortcomings such as mode collapse and lack of diversity.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderDiversityImage GenerationVocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

Multi-Scale Diffusion: Enhancing Spatial Layout in High-Resolution Panoramic Image Generation

2024-10-24 · XiaoYu Zhang, Teng Zhou, Xinlong Zhang, Jia Wei 외

Diffusion models have recently gained recognition for generating diverse and high-quality content, especially in the domain of image synthesis. These models excel not only in creating fixed-size images but also in produc…

Image Generation

High-Resolution GAN Inversion for Degraded Images in Large Diverse Datasets

2023-02-07 · Yanbo Wang, Chuming Lin, Donghao Luo, Ying Tai 외

The last decades are marked by massive and diverse image data, which shows increasingly high resolution and quality. However, some images we obtained may be corrupted, affecting the perception and the application of down…

ClusteringColorizationSuper-ResolutionVocal Bursts Intensity Prediction

Aligning Latent and Image Spaces to Connect the Unconnectable

2021-04-14 · ICCV 2021 10 · Ivan Skorokhodov, Grigorii Sotnikov, Mohamed Elhoseiny

In this work, we develop a method to generate infinite high-resolution images with diverse and complex content. It is based on a perfectly equivariant generator with synchronous interpolations in the image and latent spa…

DiversityImage GenerationInfinite Image Generation

RefineNet: Enhancing Text-to-Image Conversion with High-Resolution and Detail Accuracy through Hierarchical Transformers and Progressive Refinement

2023-12-27 · Fan Shi

In this research, we introduce RefineNet, a novel architecture designed to address resolution limitations in text-to-image conversion systems. We explore the challenges of generating high-resolution images from textual d…

Computational EfficiencyImage GenerationImage to text

DiffuseHigh: Training-free Progressive High-Resolution Image Synthesis through Structure Guidance

2024-06-26 · Younghyun Kim, Geunmin Hwang, Junyu Zhang, Eunbyung Park

Large-scale generative models, such as text-to-image diffusion models, have garnered widespread attention across diverse domains due to their creative and high-fidelity image generation. Nonetheless, existing large-scale…

Image Generation