Diffusion-based Image Translation with Label Guidance for Domain Adaptive Semantic Segmentation
Translating images from a source domain to a target domain for learning target models is one of the most common strategies in domain adaptive semantic segmentation (DASS). However, existing methods still struggle to preserve semantically-consistent local details between the original and translated images. In this work, we present an innovative approach that addresses this challenge by using source-domain labels as explicit guidance during image translation. Concretely, we formulate cross-domain image translation as a denoising diffusion process and utilize a novel Semantic Gradient Guidance (SGG) method to constrain the translation process, conditioning it on the pixel-wise source labels. Additionally, a Progressive Translation Learning (PTL) strategy is devised to enable the SGG method to work reliably across domains with large gaps. Extensive experiments demonstrate the superiority of our approach over state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingSemantic SegmentationTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Diffusion based Zero-shot Medical Image-to-Image Translation for Cross Modality Segmentation
Cross-modality image segmentation aims to segment the target modalities using a method designed in the source modality. Deep generative models can translate the target modality images into the source modality, thus enabl…
Image SegmentationImage-to-Image TranslationSegmentationSemantic Segmentation+2AGILE: A Diffusion-Based Attention-Guided Image and Label Translation for Efficient Cross-Domain Plant Trait Identification
Semantically consistent cross-domain image translation facilitates the generation of training data by transferring labels across different domains, making it particularly useful for plant trait identification in agricult…
DenoisingObjectobject-detectionObject Detection+1Improving Diffusion-based Image Translation using Asymmetric Gradient Guidance
Diffusion models have shown significant progress in image translation tasks recently. However, due to their stochastic nature, there's often a trade-off between style transformation and content preservation. Current stra…
Image ManipulationTranslationSimilarity-aware Syncretic Latent Diffusion Model for Medical Image Translation with Representation Learning
Non-contrast CT (NCCT) imaging may reduce image contrast and anatomical visibility, potentially increasing diagnostic uncertainty. In contrast, contrast-enhanced CT (CECT) facilitates the observation of regions of intere…
DiagnosticRepresentation LearningTranslationImage is All You Need to Empower Large-scale Diffusion Models for In-Domain Generation
In-domain generation aims to perform a variety of tasks within a specific domain, such as unconditional generation, text-to-image, image editing, 3D generation, and more. Early research typically required training specia…
3D GenerationAllDenoisingDiffusion Personalization