Photographic Image Synthesis with Cascaded Refinement Networks
We present an approach to synthesizing photographic images conditioned on semantic layouts. Given a semantic label map, our approach produces an image with photographic appearance that conforms to the input layout. The approach thus functions as a rendering engine that takes a two-dimensional semantic specification of the scene and produces a corresponding photographic image. Unlike recent and contemporaneous work, our approach does not rely on adversarial training. We show that photographic images can be synthesized from semantic layouts by a single feedforward network with appropriate structure, trained end-to-end with a direct regression objective. The presented approach scales seamlessly to high resolutions; we demonstrate this by synthesizing photographic images at 2-megapixel resolution, the full resolution of our training data. Extensive perceptual experiments on datasets of outdoor and indoor scenes demonstrate that images synthesized by the presented approach are considerably more realistic than alternative approaches. The results are shown in the supplementary video at https://youtu.be/0fhUJT21-bs
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationImage-to-Image TranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semi-parametric Image Synthesis
We present a semi-parametric approach to photographic image synthesis from semantic layouts. The approach combines the complementary strengths of parametric and nonparametric techniques. The nonparametric component is a …
Image GenerationImage-to-Image TranslationSemantic SegmentationCombining Markov Random Fields and Convolutional Neural Networks for Image Synthesis
This paper studies a combination of generative Markov random field (MRF) models and discriminatively trained deep convolutional neural networks (dCNNs) for synthesizing 2D images. The generative MRF acts on higher-levels…
Image GenerationTexture SynthesisMemory-efficient High-resolution OCT Volume Synthesis with Cascaded Amortized Latent Diffusion Models
Optical coherence tomography (OCT) image analysis plays an important role in the field of ophthalmology. Current successful analysis models rely on available large datasets, which can be challenging to be obtained for ce…
Pyramid Embedded Generative Adversarial Network for Automated Font Generation
In this paper, we investigate the Chinese font synthesis problem and propose a Pyramid Embedded Generative Adversarial Network (PEGAN) to automatically generate Chinese character images. The PEGAN consists of one generat…
DecoderFont GenerationGenerative Adversarial NetworkDocAligner: Annotating Real-world Photographic Document Images by Simply Taking Pictures
Recently, there has been a growing interest in research concerning document image analysis and recognition in photographic scenarios. However, the lack of labeled datasets for this emerging challenge poses a significant …
Self-Supervised Learning