paper-with-me

Papers

Bridging the gap between paired and unpaired medical image translation

2021-10-15 · Pauliina Paavilainen, Saad Ullah Akram, Juho Kannala

Medical image translation has the potential to reduce the imaging workload, by removing the need to capture some sequences, and to reduce the annotation burden for developing machine learning methods. GANs have been used successfully to translate images from one domain to another, such as MR to CT. At present, paired data (registered MR and CT images) or extra supervision (e.g. segmentation masks) is needed to learn good translation models. Registering multiple modalities or annotating structures within each of them is a tedious and laborious task. Thus, there is a need to develop improved translation methods for unpaired data. Here, we introduce modified pix2pix models for tasks CT$\rightarrow$MR and MR$\rightarrow$CT, trained with unpaired CT and MR data, and MRCAT pairs generated from the MR scans. The proposed modifications utilize the paired MR and MRCAT images to ensure good alignment between input and translated images, and unpaired CT images ensure the MR$\rightarrow$CT model produces realistic-looking CT and CT$\rightarrow$MR model works well with real CT as input. The proposed pix2pix variants outperform baseline pix2pix, pix2pixHD and CycleGAN in terms of FID and KID, and generate more realistic looking CT and MR translations.

📄 PDF Abstract BibTeX arXiv:2110.08407

Code (0)

등록된 구현이 없습니다.

Tasks

Translation

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Batch Normalization 설명 없음
Residual Connection 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Sigmoid Activation 설명 없음
Cycle Consistency Loss Cycle Consistency Loss is a type of loss used for generative adversarial networks that performs unpaired image-to-image translation. It was introduced with the…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

MaskedCLIP: Bridging the Masked and CLIP Space for Semi-Supervised Medical Vision-Language Pre-training

2025-07-23 · Lei Zhu, Jun Zhou, Rick Siow Mong Goh, Yong Liu arxiv

Foundation models have recently gained tremendous popularity in medical image analysis. State-of-the-art methods leverage either paired image-text data via vision-language pre-training or unpaired image data via self-sup…

Knowledge Distillation

Backdoor Attack on Unpaired Medical Image-Text Foundation Models: A Pilot Study on MedCLIP

2024-01-01 · Ruinan Jin, Chun-Yin Huang, Chenyu You, Xiaoxiao Li

In recent years, foundation models (FMs) have solidified their role as cornerstone advancements in the deep learning domain. By extracting intricate patterns from vast datasets, these models consistently achieve state-of…

Backdoor AttackContrastive LearningImage-text matchingText Matching

Structural Attention: Rethinking Transformer for Unpaired Medical Image Synthesis

2024-06-27 · Vu Minh Hieu Phan, Yutong Xie, BoWen Zhang, Yuankai Qi 외

Unpaired medical image synthesis aims to provide complementary information for an accurate clinical diagnostics, and address challenges in obtaining aligned multi-modal medical scans. Transformer-based models excel in im…

AnatomyImage Generation

Bridging Unpaired Facial Photos And Sketches By Line-drawings

2021-02-01 · Meimei Shang, Fei Gao, Xiang Li, Jingjie Zhu 외

In this paper, we propose a novel method to learn face sketch synthesis models by using unpaired data. Our main idea is bridging the photo domain $\mathcal{X}$ and the sketch domain $Y$ by using the line-drawing domain $…

Face Sketch SynthesisImage-to-Image TranslationStyle TransferTranslation

UCL-Dehaze: Towards Real-world Image Dehazing via Unsupervised Contrastive Learning

2022-05-04 · Yongzhen Wang, Xuefeng Yan, Fu Lee Wang, Haoran Xie 외

While the wisdom of training an image dehazing model on synthetic hazy data can alleviate the difficulty of collecting real-world hazy/clean image pairs, it brings the well-known domain shift problem. From a different ye…

Contrastive LearningImage Dehazing