paper-with-me

홈 › Papers

Hierarchical Autoregressive Image Models with Auxiliary Decoders

2019-03-06 · Jeffrey De Fauw, Sander Dieleman, Karen Simonyan

Autoregressive generative models of images tend to be biased towards capturing local structure, and as a result they often produce samples which are lacking in terms of large-scale coherence. To address this, we propose two methods to learn discrete representations of images which abstract away local detail. We show that autoregressive models conditioned on these representations can produce high-fidelity reconstructions of images, and that we can train autoregressive priors on these representations that produce samples with large-scale coherence. We can recursively apply the learning procedure, yielding a hierarchy of progressively more abstract image representations. We train hierarchical class-conditional autoregressive models on the ImageNet dataset and demonstrate that they are able to generate realistic images at resolutions of 128$\times$128 and 256$\times$256 pixels. We also perform a human evaluation study comparing our models with both adversarial and likelihood-based state-of-the-art generative models.

📄 PDF Abstract BibTeX arXiv:1903.04933

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Auxiliary Guided Autoregressive Variational Autoencoders

2017-11-30 · ICLR 2018 1 · Thomas Lucas, Jakob Verbeek

Generative modeling of high-dimensional data is a key problem in machine learning. Successful approaches include latent variable models and autoregressive models. The complementary strengths of these approaches, to model…

Decoder

Dueling Decoders: Regularizing Variational Autoencoder Latent Spaces

2019-05-17 · Bryan Seybold, Emily Fertig, Alex Alemi, Ian Fischer

Variational autoencoders learn unsupervised data representations, but these models frequently converge to minima that fail to preserve meaningful semantic information. For example, variational autoencoders with autoregre…

Decoder

Cross-pyramid consistency regularization for semi-supervised medical image segmentation

2025-11-11 · Matus Bojko, Maros Kollar, Marek Jakab, Wanda Benesova arxiv

Semi-supervised learning (SSL) enables training of powerful models with the assumption of limited, carefully labelled data and a large amount of unlabeled data to support the learning. In this paper, we propose a hybrid …

Semi-supervised Medical Image SegmentationSelf-Supervised LearningKnowledge Distillation

Practical Full Resolution Learned Lossless Image Compression

2018-11-30 · CVPR 2019 6 · Fabian Mentzer, Eirikur Agustsson, Michael Tschannen, Radu Timofte 외

We propose the first practical learned lossless image compression system, L3C, and show that it outperforms the popular engineered codecs, PNG, WebP and JPEG 2000. At the core of our method is a fully parallelizable hier…

Image Compression

StraIT: Non-autoregressive Generation with Stratified Image Transformer

2023-03-01 · Shengju Qian, Huiwen Chang, Yuanzhen Li, Zizhao Zhang 외

We propose Stratified Image Transformer(StraIT), a pure non-autoregressive(NAR) generative model that demonstrates superiority in high-quality image synthesis over existing autoregressive(AR) and diffusion models(DMs). I…

Image Generation