Local Image-to-Image Translation via Pixel-wise Highway Adaptive Instance Normalization
Recently, image-to-image translation has seen a significant success. Among many approaches, image translation based on an exemplar image, which contains the target style information, has been popular, owing to its capability to handle multimodality as well as its suitability for practical use. However, most of the existing methods extract the style information from an entire exemplar and apply it to the entire input image, which introduces excessive image translation in irrelevant image regions. In response, this paper proposes a novel approach that jointly extracts out the local masks of the input image and the exemplar as targeted regions to be involved for image translation. In particular, the main novelty of our model lies in (1) co-segmentation networks for local mask generation and (2) the local mask-based highway adaptive instance normalization technique. We demonstrate the quantitative and the qualitative evaluation results to show the advantages of our proposed approach. Finally, the code is available at https://github.com/AnonymousIclrAuthor/Highway-Adaptive-Instance-Normalization
Code (0)
등록된 구현이 없습니다.
Tasks
Image-to-Image TranslationTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Reliable Multi-modal Medical Image-to-image Translation Independent of Pixel-wise Aligned Data
The current mainstream multi-modal medical image-to-image translation methods face a contradiction. Supervised methods with outstanding performance rely on pixel-wise aligned training data to constrain the model optimiza…
Image RegistrationImage-to-Image TranslationMedical Image RegistrationModel Optimization+1Image Translation with Kernel Prediction Networks for Semantic Segmentation
Semantic segmentation relies on many dense pixel-wise annotations to achieve the best performance, but owing to the difficulty of obtaining accurate annotations for real world data, practitioners train on large-scale syn…
Semantic SegmentationFace ParsingPixel-wise Deep Image Stitching
Image stitching aims at stitching the images taken from different viewpoints into an image with a wider field of view. Existing methods warp the target image to the reference image using the estimated warp function, and …
Homography EstimationImage StitchingOptical Flow EstimationSpatially-Adaptive Pixelwise Networks for Fast Image Translation
We introduce a new generator architecture, aimed at fast and efficient high-resolution image-to-image translation. We design the generator to be an extremely lightweight function of the full-resolution image. In fact, we…
Image-to-Image TranslationInductive BiasTranslationLearning Fixed Points in Generative Adversarial Networks: From Image-to-Image Translation to Disease Detection and Localization
Generative adversarial networks (GANs) have ushered in a revolution in image-to-image translation. The development and proliferation of GANs raises an interesting question: can we train a GAN to remove an object, if pres…
domain classificationImage-to-Image TranslationTranslation