paper-with-me

홈 › Papers

ContourDiff: Unpaired Image-to-Image Translation with Structural Consistency for Medical Imaging

2024-03-16 · YuWen Chen, Nicholas Konz, Hanxue Gu, Haoyu Dong, Yaqian Chen, Lin Li, Jisoo Lee, Maciej A. Mazurowski

Preserving object structure through image-to-image translation is crucial, particularly in applications such as medical imaging (e.g., CT-to-MRI translation), where downstream clinical and machine learning applications will often rely on such preservation. However, typical image-to-image translation algorithms prioritize perceptual quality with respect to output domain features over the preservation of anatomical structures. To address these challenges, we first introduce a novel metric to quantify the structural bias between domains which must be considered for proper translation. We then propose ContourDiff, a novel image-to-image translation algorithm that leverages domain-invariant anatomical contour representations of images to preserve the anatomical structures during translation. These contour representations are simple to extract from images, yet form precise spatial constraints on their anatomical content. ContourDiff applies an input image contour representation as a constraint at every sampling step of a diffusion model trained in the output domain, ensuring anatomical content preservation for the output image. We evaluate our method on challenging lumbar spine and hip-and-thigh CT-to-MRI translation tasks, via (1) the performance of segmentation models trained on translated images applied to real MRIs, and (2) the foreground FID and KID of translated images with respect to real MRIs. Our method outperforms other unpaired image translation methods by a significant margin across almost all metrics and scenarios. Moreover, it achieves this without the need to access any input domain information during training.

📄 PDF Abstract BibTeX arXiv:2403.10786

Code (0)

등록된 구현이 없습니다.

Tasks

AnatomyImage-to-Image TranslationTranslation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Structural Attention: Rethinking Transformer for Unpaired Medical Image Synthesis

2024-06-27 · Vu Minh Hieu Phan, Yutong Xie, BoWen Zhang, Yuankai Qi 외

Unpaired medical image synthesis aims to provide complementary information for an accurate clinical diagnostics, and address challenges in obtaining aligned multi-modal medical scans. Transformer-based models excel in im…

AnatomyImage Generation

Seed-to-Seed: Image Translation in Diffusion Seed Space

2024-09-01 · Or Greenberg, Eran Kishon, Dani Lischinski

We introduce Seed-to-Seed Translation (StS), a novel approach for Image-to-Image Translation using diffusion models (DMs), aimed at translations that require close adherence to the structure of the source image. In contr…

Image-to-Image TranslationSTSTranslation

Unpaired Image-to-Image Translation for Segmentation and Signal Unmixing

2025-05-27 · Nikola Andrejic, Milica Spasic, Igor Mihajlovic, Petra Milosavljevic 외

This work introduces Ui2i, a novel model for unpaired image-to-image translation, trained on content-wise unpaired datasets to enable style transfer across domains while preserving content. Building on CycleGAN, Ui2i inc…

Domain AdaptationImage-to-Image TranslationNuclear SegmentationStyle Transfer+1

Exploring Semantic Consistency in Unpaired Image Translation to Generate Data for Surgical Applications

2023-09-06 · Danush Kumar Venkatesh, Dominik Rivoir, Micha Pfeiffer, Fiona Kolbinger 외

In surgical computer vision applications, obtaining labeled training data is challenging due to data-privacy concerns and the need for expert annotation. Unpaired image-to-image translation techniques have been explored …

Contrastive LearningImage-to-Image TranslationSemantic SegmentationTranslation

MariData: One-Step Unpaired Image Translation for Maritime Environments

2026-06-02 · Santeri Henriksson, Mehdi Asadi, Amin Majd, Juha Kalliovaara arxiv

The development on robust perception systems for Maritime Autonomous Surface Ships (MASS) is heavily constrained by the scarcity of diverse training data, particularly for adverse weather and low-light conditions. Becaus…

Image-to-Image TranslationSynthetic Data Generation