Region and Object based Panoptic Image Synthesis through Conditional GANs
Image-to-image translation is significant to many computer vision and machine learning tasks such as image synthesis and video synthesis. It has primary applications in the graphics editing and animation industries. With the development of generative adversarial networks, a lot of attention has been drawn to image-to-image translation tasks. In this paper, we propose and investigate a novel task named as panoptic-level image-to-image translation and a naive baseline of solving this task. Panoptic-level image translation extends the current image translation task to two separate objectives of semantic style translation (adjust the style of objects to that of different domains) and instance transfiguration (swap between different types of objects). The proposed task generates an image from a complete and detailed panoptic perspective which can enrich the context of real-world vision synthesis. Our contribution consists of the proposal of a significant task worth investigating and a naive baseline of solving it. The proposed baseline consists of the multiple instances sequential translation and semantic-level translation with domain-invariant content code.
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationImage-to-Image TranslationTranslationSimilar Papers 제목 키워드 기반
Interactive Image Synthesis with Panoptic Layout Generation
Interactive image synthesis from user-guided input is a challenging task when users wish to control the scene structure of a generated image with ease.Although remarkable progress has been made on layout-based image synt…
Image GenerationLayout GenerationLayout-to-Image GenerationPanoptic-based Image Synthesis
Conditional image synthesis for generating photorealistic images serves various applications for content editing to content generation. Previous conditional image synthesis algorithms mostly rely on semantic maps, and of…
Image GenerationPanoptic Neural Fields: A Semantic Object-Aware Neural Scene Representation
We present Panoptic Neural Fields (PNF), an object-aware neural scene representation that decomposes a scene into a set of objects (things) and background (stuff). Each object is represented by an oriented 3D bounding bo…
2D Panoptic Segmentation3D scene EditingDepth EstimationDepth Prediction+3Scene-Centric Unsupervised Panoptic Segmentation
Unsupervised panoptic segmentation aims to partition an image into semantically meaningful regions and distinct object instances without training on manually annotated data. In contrast to prior work on unsupervised pano…
Instance SegmentationPanoptic SegmentationPseudo LabelScene Understanding+5Extending a Large View Synthesis Model for Multi-view Panoptic Segmentation
Large view synthesis models synthesize novel views through cross-view attention without explicit 3D representations, and recent studies have shown that they learn accurate spatial correspondence from RGB supervision alon…
Panoptic SegmentationNovel View SynthesisScene Understanding3D Reconstruction